Data Lineage/Traceability in Pipelines

Data Science Asked by Gustav1985 on April 28, 2021

I want to collect information about: 1) from which single data signals a feature is composed in a ML pipeline and 2) what data preprocessing operations are/were executed on a data signal.

Does anyone have experience with this kind of information gathering and can recommend a tool or API for it? (eg. in Apache Airflow, Luigi, RapidMiner or KNIME)

May I just missed the right term that describes this kind of meta-data?

feature construction pipelines preprocessing

Add your own answers!

Ask a Question

Get help from others!

Recent Questions

How can I transform graph image into a tikzpicture LaTeX code?
How Do I Get The Ifruit App Off Of Gta 5 / Grand Theft Auto 5
Iv’e designed a space elevator using a series of lasers. do you know anybody i could submit the designs too that could manufacture the concept and put it to use
Need help finding a book. Female OP protagonist, magic
Why is the WWF pending games (“Your turn”) area replaced w/ a column of “Bonus & Reward”gift boxes?

Recent Answers

haakon.io on Why fry rice before boiling?
Peter Machado on Why fry rice before boiling?
Lex on Does Google Analytics track 404 page responses as valid page views?
Jon Church on Why fry rice before boiling?
Joshua Engel on Why fry rice before boiling?