Data Processing Engine Spark Enters Google Cloud

Tools used in game development with game engines to be togetherprovides great convenience to developers. When these tools are together, there is no need to open a separate program for light and a separate program for sound, and things are faster and more interconnected. in harmony progresses.

Artificial intelligence and machine learning There is a similar situation in the subject. from search engine giants Google, which took place today Cloud Next At the event, it introduced innovations and services that will make the work of people working in this field faster and more efficient. The company made important collaborations announced at this event.

Vertex AI Workbench to be integrated into the Vertex AI service:

First, which collectively offers the necessary tools for machine learning Vertex AI Talking about its service, Google will offer in this service. Vertex AI Workbench announced. The innovation in question is an innovation in machine learning and artificial intelligence. IDE (Integrated development environment) will act as.

This feature, which is often overlooked in platforms that offer cloud-based data processing, will prevent coders from jumping from program to program and combine their working environments. a tidy work environment will present.

BigQuery OMNI:

Following Vertex AI Workbench BigQuery Omnibasically all your data in different cloud environments from one place, i.e. via BigQuery It makes it possible for you to view, add, delete and change their places. It should be noted that Amazon Web Services (AWS) or Microsoft Azure are mentioned here as different cloud environments.

In this context, although query operations take place on these platforms, the results are of Google Cloud you can see on the home page.

Popular data processing service Apache Spark on Google Cloud:

Apache Spark known briefly as spark The service, which we can refer to as, is a popular data engine that enables large-scale data operations to be performed. The service, which is very common in fields such as machine learning, artificial intelligence and data engineering, is integrated into Google Cloud serverless.

Previously, it was seen that cloud services offer serverless Spark service within their structure. But artificial intelligence and codes specially This is an extra bonus, as they often need to be tuned in that direction to fulfill a request. bother meant.

With the serverless Spark service integrated into the Cloud, people will upload their work to the Cloud for execution and do the rest. Cloud itself will handle it. No adjustments or guidance will be required. The service in question; BigQuery will be integrated into Dataproc, Dataplex and Vertex AI.

Spanner and Google Earth

Continuing with the integration, Google is the popular open source database. PostgreSQL its own global-scale database service at Spanner offers the opportunity to use In the context of this integration, Postgres’ SQL dialect is on spanner workable it becomes

Google Earth Engine In the new service called Google Earth data larger than 50 petabytes; For users of BigQuery, Cloud’s machine learning technologies and Google Maps accessible being made. Currently, Google Earth Engine is available as a preview version.

Google’s Tableau partnership (Looker partnership bears fruit)

data analysis company lookerwas incorporated into Google Cloud in recent years. In this context LookML The platform, which offers a modeling language called Google Sheets, is preparing to offer a more unified experience with Google Sheets. In this context, Connected Sheets technology, which enables data in Google Sheets to be matched with BigQuery, LookML also with a combined experience will present.

Besides, at the event tableau Announcing its partnership with Google, with this partnership, Tableau users will have direct access to BigQuery and the service provided by Tableau will be accessed through Google Sheets.

As you can see, all the promoted services and partnerships made use of the Google Cloud platform. to make it more useful and comprehensive. made. Although we think that these developments and innovations will receive very good feedback, we will see over time what effect they will have in practice.