Pipelines and Quality

1. What is the primary quality required of a data pipeline according to the lesson?

Speed Trustworthiness Flexibility Complexity

2. In the context of data pipelines, which approach is generally preferred for AI corpora?

ETL ELT Batch processing Manual data entry

3. What is a key aspect of the ingestion quality checks mentioned in the lesson?

User feedback incorporation Schema validation Machine learning predictions Data visualization techniques

4. What does defining a freshness SLA for a source involve?

Timestamping documents and measuring delays Ensuring high-speed processing Creating more data sources Reducing document size