Astronomy and Data Science in Chile… The perfect mix.

Astronomía y Data Science

Astronomy and Data Science in Chile… The perfect mix.

by Cristían Irribarra

Few things are more alluded to in the field of science and technology in today’s news and cultural programs in Chile than Astronomy and Artificial Intelligence (AI). Interestingly, we rarely hear of how both disciplines have symbiotically empowered each other, pushing the edges of the computational paradigm at breakneck speed. The cutting edge in data storage and computing power is updated with each new super telescope to be inaugurated.

Downloading or pre-processing a modest set of astronomical data on a conventional laptop can take hours and even days, an alternative is imperative with the EELT and LSST just around the corner, promising hundreds or perhaps thousands of Terabytes of data per week. Furthermore, the computing power required for an expedited investigation is vastly greater than what can be expected with a personal computer. The management of these huge databases is today the work of Data Centers around the world, giving way to the birth of “Astro-informatics”, at the national level, the first center dedicated to this is ChiVO (Chilean Virtual Observatory).

The cutting edge in data storage and computing power is updated with each new super telescope to be inaugurated.

ChiVO is not only a warehouse with about a Petabyte (that’s a million Gigabytes) of storage capacity, but it also has services and software aimed at facilitating data processing: algorithm libraries for on-line processing, data simulators for the development of AI models, interfaces and manipulators of astronomical images are some of them.

“Data science is growing and in Chile astronomy is, clearly, one of its main drivers. “

It will undoubtedly be interesting to see how the convergence between better and better telescopes, more powerful astronomical instruments and more advanced tools for data processing will cause unprecedented discoveries in both basic science and applied computing, and with Chile as headquarters. AI will be the main driver and the area that benefits the most from this. How exciting it is to think about what kinds of tasks the algorithms of the near future will master with so much data at their disposal!

Share:

Related Post:

Astronomy and Data Science: an elementary relationship

Astronomía y Ciencia de Datos: una relación elemental

Astronomy and Data Science: an elementary relationship ( with great potential for the local economy).

Source: Forcast

Do you remember Katie Bouman? If not, we tell you that she was the scientist who at the beginning of 2019 made a photograph viral on social networks that was taken next to a stack of hard drives, which in total amounted to more than 5,000,000 gigabytes, essential to contain the total data that allowed the creation of the historic first photograph of a black hole.

That milestone, which captivated the press around the world, was just one part of the immense display resulting from the coordination of eight telescopes located in cities around the globe; in addition, it produced large volumes of data that had to be processed through a special algorithm.

This is how dealing with a large amount of information is a task that for astronomers is natural since “astronomy is a science based on data”, as stated by Mauricio Araya, PhD in Computer Science and Academic at the Federico Santa María University, who in turn points out that this analysis cannot be done separately.

“The data must be worked together. Part of that responsibility is handed over to the computer and it is precisely there where the concept of data science comes in, since various systems are developed to automate the obtaining of results ”, she concludes.

Astronomical data as a tool to contribute to development

As a result of its geography and great diversity of biomes, Chile is home to a series of natural laboratories that, according to the book «Natural Laboratories for Chile: Science and Innovation with Advantage» by Clapes UC, are strategic spaces that have a series of characteristics and conditions that allow to attract the attention of world science to do research.

When natural laboratories are located in emerging countries, they provide comparative advantages that cannot be replicated to other places or contexts given their nature. They allow the study, for example, of geophysical phenomena in the field of volcanology, natural disasters or the investigation of local species collaborating with biochemistry.

In the case of Chile, it is common to hear about the unique characteristics at the planetary level of the northern skies, which have managed to attract large astronomical consortia and several of the world’s leading universities such as the Las Campanas Observatory, operated by the Carnegie Institute of the United States, or the Observatory of the University of Tokyo in the city of Atacama (TAO).

In the words of Felipe Larraín, current Minister of Finance, with the comparative advantages of the skies of northern Chile “investments were made in infrastructure for research previously unthinkable in the country (about US $ 5 billion by 2020)”

“In contact with the frontier of knowledge”

Why is it relevant to continue developing this sector? Doctor Mauricio Araya indicates that although this is a very small area, from an economic perspective, “here in Chile we have the best astronomy in the world in terms of observatories, infrastructure and the amount of publications that are made.”

If we compare astronomy with mining, the most developed sector and the one that attracts the most dividends for Chile, Araya argues that even so the latter is not the most advanced compared to mining in other countries. However, Chile has a high level in engineering, instruments and astronomical science.

“Through astronomy we are permanently in contact with the frontier of knowledge, a window to the future to know what the problems will be,” he concludes.

All these elements help us to compose a great puzzle that shows us the importance of this area of ​​knowledge. But there seems to be a missing piece, the one that allows us to understand how valuable astronomy is when considering the other sectors of the local economy. More precisely, what will be the destination of all the knowledge acquired in data management in astronomy considering the other needs of the country?

Using the universe to solve problems on Earth.


Demian Arancibia is an Industrial Civil Engineer and Master in Systems Engineering from Cornell University, United States. His vast experience in the field of national and international astronomy led him to lead the Astroinformatics Initiative of the Ministry of Economy created in 2013.

The program, through various stages and with the support of previous initiatives, helped to determine a series of opportunities for the Chilean State from an economic dimension. The team was voluntarily integrated by prominent experts from national and international universities; Among them, Massimo Tarenghi (Italian physicist and astronomer), María Teresa Ruiz (National Prize for Exact Sciences), Juan Rada (economist), who considered local capacities, the development of a market, among other factors.

Astronomía Icon1

Thanks to the infrastructure it is possible to produce a large amount of high quality information. What Arancibia defines as “data acquisition”.

Astronomía Icon2

These data are a great value since they are knowledge about the universe.

Astronomía Icon4

There is a high level of sophistication to distribute data and the content that is generated to make it accessible.

Astronomía Icon3

This enables new opportunities in the field of data exploration and visualization.

Arancibia indicates that these opportunities (see table) are linked to existing needs in other industries such as banks, mining, or those companies that need to enhance their marketing areas. All, as in astronomy, must process large volumes of information that must be analyzed and visualized.

The above is also shared by Doctor Mauricio Araya. He says that astronomers estimate that the observable universe has more than 100 billion galaxies, so increasingly sophisticated intelligent systems will be needed to deal with the processing of all that information. This ability may well be useful in other areas such as those already mentioned. As an anecdote, Araya says that many high-level professionals, after going through astronomical centers of great relevance, come to work for famous companies such as Spotify, Amazon, among others.

Data management for the economy of the future.

Since 2017, the Ministry of the Economy, through its “Economy of the Future” area and with the preliminary support of the European Southern Observatory (ESO), ALMA and Amazon Web Services, has promoted the creation of the Data Observatory or Data Observatory Foundation, that in the words of the ministers Andrés Couve and José Ramón Valente will have as mission “to receive, process and store the data sets generated in the country, and that, due to their volume, nature and complexity, require curation, exploration, visualization and analysis that facilitates its availability for the development of knowledge, technology and innovation, and its applications for the economy and society ”. [read column] 

This opportunity for Arancibia will help advance towards a new stage that allows undertaking specific projects and initiatives: training of talents, generation of technologies, solving problems.

“A company in collaboration with this initiative and that effectively generates solutions, that addresses the problems of astronomy, has an asset that allows it to sit at the table to carry out projects on a global scale. For example, a company that currently works with the Latam company in its marketing area in Chile could collaborate with the Data Observatory to scale its solutions and be able to work with American Airline, Emirates; in other words, working with an airline that has a greater number of customers ”, he concludes.

The foregoing also impacts the job opportunities of professionals who have specialized in the field of data. Today, many of them work in academia, observatories or public initiatives, but local technology companies are emerging increasingly that are awakening the interest of various industries to solve problems using the most advanced in information technology, and with the support of talents capable of meeting those needs.

Cristián Irribarra is an astronomer from the Universidad Católica de Chile and currently works as a data scientist at Forcast, a company specialized in generating solutions based on data science, artificial intelligence, machine learning, among other technologies.

Cristián’s mission within Forcast is to receive any type of numerical data from companies and from there create a statistical model with computational tools that allow interpreting the behavior of these numbers to infer their future and what things can be obtained.

“If you are given the sales history of a store, in principle you could know how much you sell daily, the amount of profit you will have at the end of the month; However, if you intrude deeper into the data and use special systems you can optimize the product offer, know what prices to raise or lower, how people respond to price changes, how much the consumption of an object will change you in specific in the future, ”says Cristián.

To carry out this work, the expert points out that a database is essential, “that is almost an axiom of the data scientist and artificial intelligence. The more data you have about something, the better the model you use will perform; in addition, you will assign it greater versatility ”.

“Very recently we were making a prototype to detect anomalies in street light poles with cameras; that is, if they are crooked, damaged or otherwise. One of the things that most caught my attention is that we used a system that was pre-made but to interpret other images. He did not know what a post was, but with no more than a thousand images of posts taken with my cell phone, in about 30 minutes the system was able to recognize them ”.

Cristián indicates that this example demonstrates the scope of a correct interpretation of data since systems are becoming more and more powerful, “the story is knowing how to take advantage of it and use it for various industries. If we think only in detection models, there are countless possible applications that we have not yet tested. “

However, in some cases companies have effective information gathering systems, which makes the task easier and faster; in other cases, there are problems in recording the data. For the latter, Cristian indicates that it is Forcast’s task to know how to deal with those gaps and inconsistencies on the part of customers.

“Many times the registry is filled out by hand, or they started doing it recently and they don’t have a correct structure, but regardless of that we use it the same. Whether it’s dirty or not, we get to the final product, this is an essential part of what Forcast does ”, he concludes.

The great contribution of astronomy to solving problems shows us the enormous potential of this area of ​​knowledge in the country. Chile will concentrate 70% of astronomical observations by 2024, so a strategy and the support of various productive sectors are required to take advantage of it. 

Share:

Related Post: