Modern Data Architectures with Python

Modern Data Architectures with Python
Author :
Publisher : Packt Publishing Ltd
Total Pages : 318
Release :
ISBN-10 : 9781801076418
ISBN-13 : 1801076413
Rating : 4/5 (413 Downloads)

Book Synopsis Modern Data Architectures with Python by : Brian Lipp

Download or read book Modern Data Architectures with Python written by Brian Lipp and published by Packt Publishing Ltd. This book was released on 2023-09-29 with total page 318 pages. Available in PDF, EPUB and Kindle. Book excerpt: Build scalable and reliable data ecosystems using Data Mesh, Databricks Spark, and Kafka Key Features Develop modern data skills used in emerging technologies Learn pragmatic design methodologies such as Data Mesh and data lakehouses Gain a deeper understanding of data governance Purchase of the print or Kindle book includes a free PDF eBook Book DescriptionModern Data Architectures with Python will teach you how to seamlessly incorporate your machine learning and data science work streams into your open data platforms. You’ll learn how to take your data and create open lakehouses that work with any technology using tried-and-true techniques, including the medallion architecture and Delta Lake. Starting with the fundamentals, this book will help you build pipelines on Databricks, an open data platform, using SQL and Python. You’ll gain an understanding of notebooks and applications written in Python using standard software engineering tools such as git, pre-commit, Jenkins, and Github. Next, you’ll delve into streaming and batch-based data processing using Apache Spark and Confluent Kafka. As you advance, you’ll learn how to deploy your resources using infrastructure as code and how to automate your workflows and code development. Since any data platform's ability to handle and work with AI and ML is a vital component, you’ll also explore the basics of ML and how to work with modern MLOps tooling. Finally, you’ll get hands-on experience with Apache Spark, one of the key data technologies in today’s market. By the end of this book, you’ll have amassed a wealth of practical and theoretical knowledge to build, manage, orchestrate, and architect your data ecosystems.What you will learn Understand data patterns including delta architecture Discover how to increase performance with Spark internals Find out how to design critical data diagrams Explore MLOps with tools such as AutoML and MLflow Get to grips with building data products in a data mesh Discover data governance and build confidence in your data Introduce data visualizations and dashboards into your data practice Who this book is forThis book is for developers, analytics engineers, and managers looking to further develop a data ecosystem within their organization. While they’re not prerequisites, basic knowledge of Python and prior experience with data will help you to read and follow along with the examples.

Modern Data Architectures with Python Related Books

Modern Data Architectures with Python
Language: en
Pages: 318
Authors: Brian Lipp
Categories: Computers
Type: BOOK - Published: 2023-09-29 - Publisher: Packt Publishing Ltd

GET EBOOK

Build scalable and reliable data ecosystems using Data Mesh, Databricks Spark, and Kafka Key Features Develop modern data skills used in emerging technologies L
Data Management at Scale
Language: en
Pages: 404
Authors: Piethein Strengholt
Categories: Computers
Type: BOOK - Published: 2020-07-29 - Publisher: "O'Reilly Media, Inc."

GET EBOOK

As data management and integration continue to evolve rapidly, storing all your data in one place, such as a data warehouse, is no longer scalable. In the very
Data Analysis with Python
Language: en
Pages: 491
Authors: David Taieb
Categories: Computers
Type: BOOK - Published: 2018-12-31 - Publisher: Packt Publishing Ltd

GET EBOOK

Learn a modern approach to data analysis using Python to harness the power of programming and AI across your data. Detailed case studies bring this modern appro
Scalable Big Data Architecture
Language: en
Pages: 147
Authors: Bahaaldine Azarmi
Categories: Computers
Type: BOOK - Published: 2015-12-31 - Publisher: Apress

GET EBOOK

This book highlights the different types of data architecture and illustrates the many possibilities hidden behind the term "Big Data", from the usage of No-SQL
MASTER PYTHON DATA ENGINEERING with Virtual AI Tutoring
Language: en
Pages: 147
Authors: Diego Rodrigues
Categories: Business & Economics
Type: BOOK - Published: 2024-11-19 - Publisher: Diego Rodrigues

GET EBOOK

Imagine acquiring a book and, as a bonus, gaining access to a 24/7 AI-assisted Virtual Tutoring to personalize your learning journey, reinforce knowledge, and r