Metadata-Driven Cloud Analytics Intelligence Framework

Authors

  • Dileep Valiki Author
    Competing Interests

    AI,ML

Keywords:

Cloud Analytics,Metadata-Driven Architecture,Scalable Data Operations,Intelligent Data Frameworks,Unified Data Management,Cloud Data Intelligence,Analytics Automation,Operational Scalability,Metadata Integration,Distributed Cloud Computing.

Abstract

The Intelligence Layer for Cloud Analytics Operations supports scalable analytics operations over large volumes of industrial metadata for a wide range of users. It harnesses the processing and storage power of cloud systems, integrating globally distributed information. The Intelligence Layer transforms metadata into business intelligencetasks by making it intelligible for decision making by enabling familiarizations through browsing as well as diversity in ,choosing different analytics for generating preferred results. Metadata+-based intelligence tasks can include business processes, organizations, locations, data prov­enance, archives, visualizations and GST. The analytics intelligence oper­ations are made available to users through a service catalog aligned with the service model in cloud computing. The analytics on nearchat-service in cloud computing enables users to get information on Global Service Tax (GST) in the country. It provides GST-related information such as activities liable to GST, percentage of GST, location of GST payments and a free-service area for browsing various rules and regulations relating to GST. Metadata+-based business-intelligence operations sup­port complete business-processtransport oper­ations for an organization.

The Intelligence Layer for Cloud Analytics Operations provides scalability for mining intelligent information from metadata. These analytics operations enable users to get information about the Metadata+ repository and to generate business intelligence using different pipelines. The key approaches for scale­able cloud-analytics operations are distributed-processing and distributed-storage approaches, where cloud compu­ting supports elastic scaling by providing the required processing, storage and network assets within a portal under a pay-per-use model. The distribution of big data over multiple data stores using a data-storage distribution scheme enables faster opera­tion execution through Hadoop and HBase on the data stored in HDFS or HBase, respectively.

Downloads

Download data is not yet available.

References

1. Baijens, J., Huygh, T., & Helms, R. (2021). Establishing and theorising data analytics governance: A descriptive framework and a VSM-based view. Journal of Decision Systems, 30(1), 101–122.

2. Boukraaa, D., Balab, M., & Rizzi, S. (2024). Metadata management in data lake environments: A survey. Journal of Library Metadata, 24(4), 215–274.

3. Davuluri, P. S. L. (2023). AI-Augmented Sanctions Screening: Enhancing Accuracy and Latency in Real Time Compliance Systems. AI-Augmented Sanctions Screening: Enhancing Accuracy and Latency in Real Time Compliance Systems (December 15, 2023).

4. Dehghani, Z. (2022). Data mesh: Delivering data-driven value at scale. O’Reilly Media.

5. Jahnke, N. F., & Otto, B. (2023). Data catalogs in the enterprise: Applications and integration. Datenbank-Spektrum, 23, 89–96.

6. Machado, I. A., Costa, C. M., & Santos, M. Y. (2022). Data mesh: Concepts and principles of a paradigm shift in data architectures. Procedia Computer Science, 196, 263–271.

7. Machado, I. A., Costa, C. M., & Santos, M. Y. (2022). Advancing data architectures with data mesh implementations. In M. Helfert, C. Klein, O. C. C. Leal, & A. P. O. O. (Eds.), Lecture Notes in Business Information Processing (Vol. 452, pp. 10–18). Springer.

8. Mukesh, A., & Aitha, A. R. (2021). Insurance Risk Assessment Using Predictive Modeling Techniques. International Journal of Emerging Research in Engineering and Technology, 2(4), 68-79.

9. Nadal, S., Jovanovic, P., Bilalli, B., & Romero, O. (2022). Operationalizing and automating data governance. Journal of Big Data, 9, Article 117.

10. Theodorou, V., Gerostathopoulos, I., Alshabani, I., Abelló, A., & Breitgand, D. (2021). MEDAL: An AI-driven data fabric concept for elastic cloud-to-edge intelligence. In L. Barolli, I. Woungang, & T. Enokido (Eds.), Advanced information networking and applications (pp. 561–571). Springer.

11. Wider, A., Verma, S., & Akhtar, A. (2023). Decentralized data governance as part of a data mesh platform: Concepts and approaches. arXiv.

12. Schneider, J., Gröger, C., Lutsch, A., Schwarz, H., & Mitschang, B. (2024). The lakehouse: State of the art on concepts and technologies. SN Computer Science, 5, Article 449.

13. Sulova, S., & Marinova, O. (2024). Metadata management framework for business intelligence driven data lakes. Journal of the University of Economics – Varna.

14. Priebe, T., Neumaier, S., & Markus, S. (2021). Finding your way through the jungle of big data architectures. In Proceedings of the International Conference on Big Data Analytics and Knowledge Discovery.

15. Inala, R. (2023). AI-powered investment decision support systems: Building smart data products with embedded governance controls. Journal for ReAttach Therapy and Developmental Diversities, 6(10), 2251-2266.

16. Bode, J., Otto, B., & other contributors. (2023). Data products, data mesh, and data fabric: A comparison of modern data architectures. Business & Information Systems Engineering.

17. Araújo Machado, I., Costa, C., & Santos, M. Y. (2022). Data architecture modernization through data mesh principles. In Lecture Notes in Business Information Processing. Springer.

18. Joshi, S., et al. (2021). Metadata-driven approaches for self-service data platforms. In Proceedings of the International Conference on Information Systems.

19. Priebe, T., Neumaier, S., & Markus, S. (2021). Big data architectures and their role in data-driven organizations. Proceedings of the International Conference on Big Data Analytics.

20. Jahnke, N. F., & Otto, B. (2023). Metadata management and data catalog integration in enterprise information systems. Datenbank-Spektrum, 23, 89–96.

21. Bode, J., Otto, B., & other contributors. (2024). Data products, data mesh, and data fabric: A comparison of modern data management approaches. Business & Information Systems Engineering.

22. Boukraaa, D., Balab, M., & Rizzi, S. (2024). Metadata management approaches for data lake environments. Journal of Library Metadata, 24(4), 215–274.

23. Gottimukkala, V. R. R. (2024). Federated Learning Approaches for Fraud Detection in International Payment Systems. https://www. jisem-journal. com/download/118_JISEM. pdf.

24. Jahnke, N. F., & Otto, B. (2023). Data catalog applications and enterprise metadata management. Datenbank-Spektrum, 23, 89–96.

25. Machado, I. A., Costa, C. M., & Santos, M. Y. (2022). Data mesh as a distributed architecture for scalable analytics. Procedia Computer Science, 196, 263–271.

26. Nadal, S., Jovanovic, P., Bilalli, B., & Romero, O. (2022). Automating data governance activities across the data lifecycle. Journal of Big Data, 9, Article 117.

27. Theodorou, V., Gerostathopoulos, I., Alshabani, I., Abelló, A., & Breitgand, D. (2021). AI-driven data fabrics for elastic cloud-to-edge intelligence. In Advanced Information Networking and Applications (pp. 561–571). Springer.

28. Schneider, J., Gröger, C., Lutsch, A., Schwarz, H., & Mitschang, B. (2024). Lakehouse architectures for modern data management and analytics. SN Computer Science, 5, Article 449.

29. Boukraaa, D., Balab, M., & Rizzi, S. (2024). Metadata discovery and management in modern data lake architectures. Journal of Library Metadata, 24(4), 215–274.

30. Jahnke, N. F., & Otto, B. (2023). Data catalogs in enterprise data management: Applications, integration, and governance. Datenbank-Spektrum, 23, 89–96.

31. Machado, I. A., Costa, C. M., & Santos, M. Y. (2022). Distributed data management and governance with data mesh architectures. Procedia Computer Science, 196, 263–271.

32. Nadal, S., Jovanovic, P., Bilalli, B., & Romero, O. (2022). From manual to automated data governance: A lifecycle-oriented approach. Journal of Big Data, 9, Article 117.

33. Theodorou, V., Gerostathopoulos, I., Alshabani, I., Abelló, A., & Breitgand, D. (2021). MEDAL: An AI-driven data fabric concept for scalable cloud-edge data intelligence. Lecture Notes in Networks and Systems, 227, 561–571.

34. Schneider, J., Gröger, C., Lutsch, A., Schwarz, H., & Mitschang, B. (2024). The lakehouse: Concepts, technologies, and implications for modern analytics platforms. SN Computer Science, 5, Article 449.

Additional Files

Published

2024-03-10

Data Availability Statement

None

How to Cite

Metadata-Driven Cloud Analytics Intelligence Framework. (2024). Global Research Development(GRD), 2(01). https://grdjournals.org/index.php/grd/article/view/23

Similar Articles

21-26 of 26

You may also start an advanced similarity search for this article.