Join Sign in

Priyanka Sil

Member since 2023

Gold League

18495 points
Serverless Data Processing with Dataflow: Operations Earned אוג 19, 2024 EDT
Build Batch Data Pipelines on Google Cloud Earned יונ 21, 2024 EDT
Build a Data Mesh with Dataplex Earned יונ 21, 2024 EDT
Build a Data Warehouse with BigQuery Earned יונ 18, 2024 EDT
Building Resilient Streaming Systems on Google Cloud Platform Earned יונ 10, 2024 EDT
Google Cloud Big Data and Machine Learning Fundamentals Earned מאי 10, 2024 EDT
Serverless Data Processing with Dataflow: Foundations Earned אפר 16, 2024 EDT
Smart Analytics, Machine Learning, and AI on Google Cloud Earned מרץ 21, 2024 EDT
Build Data Lakes and Data Warehouses on Google Cloud Earned פבר 29, 2024 EST
Preparing for your Professional Data Engineer Journey Earned פבר 15, 2024 EST
Creating New BigQuery Datasets and Visualizing Insights Earned אוג 22, 2023 EDT
Digital Transformation with Google Cloud - בעברית Earned יונ 22, 2023 EDT
Exploring and Preparing your Data with BigQuery Earned אפר 26, 2023 EDT

In the last installment of the Dataflow course series, we will introduce the components of the Dataflow operational model. We will examine tools and techniques for troubleshooting and optimizing pipeline performance. We will then review testing, deployment, and reliability best practices for Dataflow pipelines. We will conclude with a review of Templates, which makes it easy to scale Dataflow pipelines to organizations with hundreds of users. These lessons will help ensure that your data platform is stable and resilient to unanticipated circumstances.

Learn more

In this intermediate course, you will learn to design, build, and optimize robust batch data pipelines on Google Cloud. Moving beyond fundamental data handling, you will explore large-scale data transformations and efficient workflow orchestration, essential for timely business intelligence and critical reporting. Get hands-on practice using Dataflow for Apache Beam and Serverless for Apache Spark (Dataproc Serverless) for implementation, and tackle crucial considerations for data quality, monitoring, and alerting to ensure pipeline reliability and operational excellence. A basic knowledge of data warehousing, ETL/ELT, SQL, Python, and Google Cloud concepts is recommended.

Learn more

Complete the introductory Build a Data Mesh with Dataplex skill badge to demonstrate skills in the following: building a data mesh with Dataplex to facilitate data security, governance, and discovery on Google Cloud. You practice and test your skills in tagging assets, assigning IAM roles, and assessing data quality in Dataplex.

Learn more

Complete the intermediate Build a Data Warehouse with BigQuery skill badge course to demonstrate skills in the following: joining data to create new tables, troubleshooting joins, appending data with unions, creating date-partitioned tables, and working with JSON, arrays, and structs in BigQuery.

Learn more

This 1-week, accelerated on-demand course builds upon Google Cloud Platform Big Data and Machine Learning Fundamentals. Through a combination of video lectures, demonstrations, and hands-on labs, you'll learn to build streaming data pipelines using Google cloud Pub/Sub and Dataflow to enable real-time decision making. You will also learn how to build dashboards to render tailored output for various stakeholder audiences.

Learn more

This course introduces the Google Cloud big data and machine learning products and services that support the data-to-AI lifecycle. It explores the processes, challenges, and benefits of building a big data pipeline and machine learning models with Vertex AI on Google Cloud.

Learn more

This course is part 1 of a 3-course series on Serverless Data Processing with Dataflow. In this first course, we start with a refresher of what Apache Beam is and its relationship with Dataflow. Next, we talk about the Apache Beam vision and the benefits of the Beam Portability framework. The Beam Portability framework achieves the vision that a developer can use their favorite programming language with their preferred execution backend. We then show you how Dataflow allows you to separate compute and storage while saving money, and how identity, access, and management tools interact with your Dataflow pipelines. Lastly, we look at how to implement the right security model for your use case on Dataflow.

Learn more

Incorporating machine learning into data pipelines increases the ability to extract insights from data. This course covers ways machine learning can be included in data pipelines on Google Cloud. For little to no customization, this course covers AutoML. For more tailored machine learning capabilities, this course introduces Notebooks and BigQuery machine learning (BigQuery ML). Also, this course covers how to productionalize machine learning solutions by using Vertex AI.

Learn more

While the traditional approaches of using data lakes and data warehouses can be effective, they have shortcomings, particularly in large enterprise environments. This course introduces the concept of a data lakehouse and the Google Cloud products used to create one. A lakehouse architecture uses open-standard data sources and combines the best features of data lakes and data warehouses, which addresses many of their shortcomings.

Learn more

This course helps learners create a study plan for the PDE (Professional Data Engineer) certification exam. Learners explore the breadth and scope of the domains covered in the exam. Learners assess their exam readiness and create their individual study plan.

Learn more

This is the second course in the Data to Insights course series. Here we will cover how to ingest new external datasets into BigQuery and visualize them with Looker Studio. We will also cover intermediate SQL concepts like multi-table JOINs and UNIONs which will allow you to analyze data across multiple data sources. Note: Even if you have a background in SQL, there are BigQuery specifics (like handling query cache and table wildcards) that may be new to you. After completing this course, enroll in the Achieving Advanced Insights with BigQuery course.

Learn more

מהי טכנולוגיית ענן ומהו מדע הנתונים? וחשוב יותר, איך הם יכולים לעזור לכם, לצוות שלכם ולעסק שלכם? קורס המבוא הזה בנושא טרנספורמציה דיגיטלית מתאים למי שרוצה ללמוד על טכנולוגיית הענן כדי להתמקצע ולהצטיין בעבודתו וכדי לעזור בפיתוח העתיד של העסק. בקורס יוגדרו מונחי יסוד כגון הענן, נתונים וטרנספורמציה דיגיטלית. בנוסף, נבחן דוגמאות של חברות מרחבי העולם שמשתמשות בטכנולוגיית הענן כדי לבצע טרנספורמציה בעסק. הקורס כולל סקירה של סוגי ההזדמנויות שיש לחברות ושל האתגרים הנפוצים שחברות מתמודדות איתם במהלך טרנספורמציה דיגיטלית. הקורס גם מדגים איך עמודי התווך של פתרונות Google Cloud יכולים לעזור בתהליך. חשוב לומר: טרנספורמציה דיגיטלית לא קשורה רק לשימוש בטכנולוגיות חדשות. כדי הטרנספורמציה תהיה מלאה, ארגונים צריכים גם ליישם חדשנות ולפתח דפוס חשיבה שמקדם חדשנות בכל התחומים והצוותים. השיטות המומלצות המתוארות בקורס יעזרו לכם להשיג את המטרה הזו.

Learn more

In this course, we see what the common challenges faced by data analysts are and how to solve them with the big data tools on Google Cloud. You’ll pick up some SQL along the way and become very familiar with using BigQuery and Dataprep to analyze and transform your datasets. This is the first course of the From Data to Insights with Google Cloud series. After completing this course, enroll in the Creating New BigQuery Datasets and Visualizing Insights course.

Learn more