{"product_id":"data-ingestion-with-python-cookbook-a-practical-guide-to-ingesting-monitoring-and-identifying-errors-in-the-data-ingestion-process-9781837632602","title":"Data Ingestion with Python Cookbook: A practical guide to ingesting, monitoring, and identifying errors in the data ingestion process","description":"\u003cp\u003e\u003cstrong\u003eDeploy your data ingestion pipeline, orchestrate, and monitor efficiently to prevent loss of data and quality\u003c\/strong\u003e\u003c\/p\u003e\u003cp\u003e\u003cstrong\u003ePurchase of the print or Kindle book includes a free PDF eBook\u003c\/strong\u003e\u003c\/p\u003e\u003cp\u003e\u003cbr\u003e\u003c\/p\u003e\u003cp\u003e\u003cstrong\u003eKey Features: \u003c\/strong\u003e\u003c\/p\u003e\u003cul\u003e\n\u003cli\u003eHarness best practices to create a Python and PySpark data ingestion pipeline\u003c\/li\u003e\n\u003cli\u003eSeamlessly automate and orchestrate your data pipelines using Apache Airflow\u003c\/li\u003e\n\u003cli\u003eBuild a monitoring framework by integrating the concept of data observability into your pipelines\u003c\/li\u003e\n\u003c\/ul\u003e\u003cp\u003e\u003cbr\u003e\u003c\/p\u003e\u003cp\u003e\u003cstrong\u003eBook Description: \u003c\/strong\u003e\u003c\/p\u003e\u003cp\u003eData Ingestion with Python Cookbook offers a practical approach to designing and implementing data ingestion pipelines. It presents real-world examples with the most widely recognized open source tools on the market to answer commonly asked questions and overcome challenges.\u003c\/p\u003e\u003cp\u003eYou'll be introduced to designing and working with or without data schemas, as well as creating monitored pipelines with Airflow and data observability principles, all while following industry best practices. The book also addresses challenges associated with reading different data sources and data formats. As you progress through the book, you'll gain a broader understanding of error logging best practices, troubleshooting techniques, data orchestration, monitoring, and storing logs for further consultation.\u003c\/p\u003e\u003cp\u003eBy the end of the book, you'll have a fully automated set that enables you to start ingesting and monitoring your data pipeline effortlessly, facilitating seamless integration with subsequent stages of the ETL process.\u003c\/p\u003e\u003cp\u003e\u003cbr\u003e\u003c\/p\u003e\u003cp\u003e\u003cstrong\u003eWhat You Will Learn: \u003c\/strong\u003e\u003c\/p\u003e\u003cul\u003e\n\u003cli\u003eImplement data observability using monitoring tools\u003c\/li\u003e\n\u003cli\u003eAutomate your data ingestion pipeline\u003c\/li\u003e\n\u003cli\u003eRead analytical and partitioned data, whether schema or non-schema based\u003c\/li\u003e\n\u003cli\u003eDebug and prevent data loss through efficient data monitoring and logging\u003c\/li\u003e\n\u003cli\u003eEstablish data access policies using a data governance framework\u003c\/li\u003e\n\u003cli\u003eConstruct a data orchestration framework to improve data quality\u003c\/li\u003e\n\u003c\/ul\u003e\u003cp\u003e\u003cbr\u003e\u003c\/p\u003e\u003cp\u003e\u003cstrong\u003eWho this book is for: \u003c\/strong\u003e\u003c\/p\u003e\u003cp\u003eThis book is for data engineers and data enthusiasts seeking a comprehensive understanding of the data ingestion process using popular tools in the open source community. For more advanced learners, this book takes on the theoretical pillars of data governance while providing practical examples of real-world scenarios commonly encountered by data engineers.\u003cbr\u003e\u003c\/p\u003e","brand":"Packt Publishing","offers":[{"title":"Default Title","offer_id":50509673070866,"sku":"9781837632602","price":36.99,"currency_code":"USD","in_stock":true}],"thumbnail_url":"\/\/cdn.shopify.com\/s\/files\/1\/0831\/4771\/8930\/files\/img_79ddfb64-19fb-4fa7-8c9c-2691ca0816b8.jpg?v=1730904502","url":"https:\/\/surprise-castle.myshopify.com\/products\/data-ingestion-with-python-cookbook-a-practical-guide-to-ingesting-monitoring-and-identifying-errors-in-the-data-ingestion-process-9781837632602","provider":"Surprise Castle","version":"1.0","type":"link"}