{"product_id":"data-engineering-design-patterns-recipes-for-solving-the-most-common-data-engineering-problems-9781098165819","title":"Data Engineering Design Patterns: Recipes for Solving the Most Common Data Engineering Problems","description":"\u003cp\u003eData projects are an intrinsic part of an organization's technical ecosystem, but data engineers in many companies continue to work on problems that others have already solved. This hands-on guide shows you how to provide valuable data by focusing on various aspects of data engineering, including data ingestion, data quality, idempotency, and more. \u003c\/p\u003e\u003cp\u003eAuthor Bartosz Konieczny guides you through the process of building reliable end-to-end data engineering projects, from data ingestion to data observability, focusing on data engineering design patterns that solve common business problems in a secure and storage-optimized manner. Each pattern includes a user-facing description of the problem, solutions, and consequences that place the pattern into the context of real-life scenarios. \u003c\/p\u003e\u003cp\u003eThroughout this journey, you'll use open source data tools and public cloud services to apply each pattern. You'll learn: \u003c\/p\u003e\u003cul\u003e \u003cli\u003eChallenges data engineers face and their impact on data systems \u003c\/li\u003e\n\u003cli\u003eHow these challenges relate to data system components \u003c\/li\u003e\n\u003cli\u003eUseful applications of data engineering patterns \u003c\/li\u003e\n\u003cli\u003eHow to identify and fix issues with your current data components \u003c\/li\u003e\n\u003cli\u003eTechnology-agnostic solutions to new and existing data projects, with open source implementation examples \u003c\/li\u003e\n\u003c\/ul\u003e \u003cp\u003eBartosz Konieczny is a freelance data engineer who's been coding since 2010. He's held various senior hands-on positions that allowed him to work on many data engineering problems in batch and stream processing.\u003cbr\u003e\u003cbr\u003e\u003cbr\u003e\u003cb\u003eAbout the Author\u003c\/b\u003e\u003cbr\u003e\u003cb\u003e\u003ci\u003eKonieczny, Bartosz:\u003c\/i\u003e\u003c\/b\u003e - Bartosz is a freelance data engineer enthusiast who has been coding since 2010. He has held various senior hands-on positions that helped him work on many data engineering problems, such as sessionization, data ingestion, data cleansing, ordered data processing, or data migration. He enjoys solving data challenges with public cloud services and Open Source technologies, especially Apache Spark, Apache Kafka, Apache Airflow, and Delta Lake. You can contact him at contact@waitingforcode.com. \u003c\/p\u003e\u003cp\u003e Besides that, you can read his blog posts at waitingforcode.com, or improve your data engineering skills with one of his courses or training. Bartosz is also an occasional speaker at conferences and meetups, including Data+AI Summit, Big Data Technology Warsaw Summit, or NDC Porto.\u003c\/p\u003e","brand":"O'Reilly Media","offers":[{"title":"Default Title","offer_id":51276833784082,"sku":"9781098165819","price":57.99,"currency_code":"USD","in_stock":true}],"thumbnail_url":"\/\/cdn.shopify.com\/s\/files\/1\/0831\/4771\/8930\/files\/img_4fc24aa1-624f-41a5-bbc1-c264aa84b5c1.jpg?v=1747141716","url":"https:\/\/surprise-castle.myshopify.com\/products\/data-engineering-design-patterns-recipes-for-solving-the-most-common-data-engineering-problems-9781098165819","provider":"Surprise Castle","version":"1.0","type":"link"}