QUESTION:
How should I transform already ingested data
ANSWER
Here are the options of what you can do:
- Reingest from the source and apply field mappings at the time of ingestion.
- You can use
Insert into
is a SQL command that allows you to add or patch documents using theINSERT INTO
statement in a SQL query, which allows you to insert the result of a query into a collection. You can learn more about the syntax and usage of the SQLINSERT INTO
statement here.INSERT INTO
is generally not recommended to use heavily because it uses query execution resources. - You can perform the transformation in every query at run time. This will use query execution resources.
The recommended course is to use the first option and use aliases to point to the new collection. Here, you don’t use query execution resources and there’s no downtime.