Watch recordings of all presentations made during our Community Day Summit held during October 2024. Find out more about this event and read our blog review of the event.
In addition to these presentations, we also held a Technical Poster Competition for students to present work they have completed on projects leveraging HPCC Systems. See our poster contest wiki to find out more about our 2024 Poster Contest participants and winners.
Resources
See the full Agenda - done
2024 Poster Contest - Meet the students, read abstracts and view posters - done
Presentation Tracks and Content
Plenary Sessions
Join us for the opening and closing sessions from the 11th annual HPCC Systems Community Virtual Summit.
Welcome & Plenary Keynotes
Gavin Halliday, SVP and Head of Platform Engineering, LexisNexis® Risk Solutions/ Michael Stefanick, Managing Director, EY
Watch as Gavin Halliday kicked off the 11th annual HPCC Systems Community Virtual Summit, as well as hear from our community keynote speaker Michael Stefanick, who presented, AI + Human: How AI will Disrupt Work and Allow Workers to Thrive.
Awards Ceremony & Plenary
Trish McCall, Sr Director Program Management, Hugo Watanuki, Manager Community Tech Programs, George S Foreman, Business Analyst II, Bob Foreman, Software Engineering Lead LexisNexis Risk Solutions
Join us for the long-awaited announcement of the 2024 Community Awards and Poster Competition winners, followed by our afternoon keynote honoring our academic community and engagement.
Platform Evolution
Take a look at the latest improvements and innovative features in the platform.
The Latest Advancements in HPCC Systems Observability
Rodrigo Pastrana & Mark Kelly, LexisNexis Risk Solutions
Learn about the latest advancements in HPCC Systems observability, focused on the Open telemetry-based instrumentation framework and how this feature can help you streamline your ECL query workload and ensure your HPCC Systems deployments are functioning at full strength!How to Secure Your Containerized HPCC Systems Platform Using Terraform
Godji Fortil, LexisNexis Risk Solutions
In our presentations over the last couple of years, we showed you how to deploy the containerized HPCC Systems Platform. As a following step, knowing how to secure your cluster over the internet is very important. This presentation demonstrated how that can be done in the best ways possible using Terraform, htpasswd, or Azure Active Directory.Parquet Plugin Usage / Test Suite for the Parquet Plugin
Jack del Vecchio & Ilhan Gelle, LexisNexis Risk Solutions
The HPCC Systems Parquet Plugin has received many performance improvements and bug fixes over the past year. In this two-part session, Jack highlighted the improvements compared to native file formats and went into detail about the usage of the Plugin and how to leverage the Parquet file format. Ilhan then provided an overview of the robust test suite for the HPCC Systems Parquet plugin and how it helps enhance the reliability and efficiency of Parquet integration within HPCC Systems.What’s New – ECL Watch and IDEs
Kunal Aswani, LexisNexis Risk Solutions
Catch up on the latest changes to the interface and appearance in the world of ECL development.
Data DNA
See how these projects enhanced the integrating processes and capabilities of the platform to streamline, enrich and visualize data.
Streamlining Business Tasks with HPCC Systems Clusters and Tombolo
Yadhap Dahal & Matthew Fancher, LexisNexis Risk Solutions
Introducing Tombolo, an innovative open-source project designed to enhance the already robust features, speed, and capabilities of HPCC Systems clusters. Our aim is to introduce a user-friendly web application that caters to both technical and non-technical users, enabling seamless interaction with HPCC Systems clusters. During our presentation, we’ll explore the capabilities of Tombolo, including creating workflows and monitoring assets. Additionally in this session, we’ll highlight the application’s ability to proactively send timely notifications. Moreover, we’ll provide a comprehensive overview of Tombolo’s intuitive dashboard.Power BI Integration with HPCC Systems
Harsh Raj & Srinivasan Kothandam, LexisNexis Risk Solutions
Learn more about this integration package that enables analysts and business users to read HPCC Systems native files directly from Power BI.Using NLP++ to Build a Brazilian Address Cleaner in HPCC Systems
Guilherme da Silva, LexisNexis Risk Solutions
ADD FROM YOUTUBEEnhancing Legal Assistance Through Data Enrichment with HPCC Systems
Nihar Mandahas, Skanda P R, Manvith L B, Pratheek Rao MP, Arya Hariharan, & Dr. Jyoti Shetty,RVCE
ADD FROM YOUTUBEIntegrating Microsoft Fabric and HPCC Systems for Security Analytics
Sowmya Myneni & Kushi Kiran, LexisNexis Risk Solutions
Integrating HPCC Systems with Microsoft Fabric and Power BI offers a seamless workflow for transforming, linking, and visualizing data. HPCC Systems, with its user-friendly ECL language, efficiently handles complex data transformations, which can then be imported into Microsoft Fabric. From there, Power BI can be used to create interactive and insightful visualizations and reports. This integration simplifies the process of turning raw data into actionable insights, making it an effective solution for data analysis and presentation.
Productivity Tools
These projects highlighted tools and best practices for maximizing efficiency.
We’ve Come a Long Way From README.txt – Improvements in the Platform Documentation
Jim DeFabia, LexisNexis Risk Solutions
ADD FROM YOUTUBELLM for ECL Code Generation Using Llama3
Connor Davis, DataSeers
ADD FROM YOUTUBEImplementing Conditional Cleanup after Regression Testing in HPCC Systems
Goutami Sooda, Arya Vinod, Ahana Patil, & Chandana S, RVCE
ADD FROM YOUTUBEData 360° View Using HPCC Systems
S Dhanush & Shreyas Shankar, RVCE
ADD FROM YOUTUBETesting Best Practices of the HPCC Systems Platform (Now and in the Future)
Christopher Lo, LexisNexis Risk Solutions
ADD FROM YOUTUBENavigating the Platform Build System
Michael Gardner, LexisNexis Risk Solutions
ADD FROM YOUTUBEFrom In-House to Open Source: The Journey of PyHPCC
Amila de Silva & Rohith Podugu, LexisNexis Risk Solutions
PyHPCC is a Python package and wrapper built around the HPCC Systems web services that facilitates communication between Python and HPCC Systems. It was originally developed as a LexisNexis Risk Solutions internal-only tool to automate repetitive work done on HPCC Systems. Since the evangelization of PyHPCC began in 2022, there has been growing interest across the organization and the broader HPCC Systems community to adopt PyHPCC.
Fueling Success
Here are the real world use cases and success stories leveraging HPCC Systems.
Building an NLP Pipeline for Electronic Health Records and Brain MRI Classification
Vishalakshi Prabhu, Eshaan Mathur, Nikhil Vasu, & Prashant Ronad, RVCE
ADD FROM YOUTUBELearned Cache Size Setting for Roxie Clusters
Yifan Wang, University of Hawaii
ADD FROM YOUTUBEMachine Learning and Cybersecurity Analytics Using the NSL-KDD Dataset
Zularbine Kamal, Kennesaw State University
Model Inversion Attacks with the HPCC Systems Platform
Andrew Polisetty, Kennesaw State University
School Safety and Security Using RFID and Drones
Taiowa Donovan & Nick Schwartz, American Heritage School
Exploring the Capabilities of HPCC Systems in Facilitating Inter Fog Communication
Henrique Antonio Buzin Vargas, Federal University of Santa Catarina (UFSC)
Internship to Impact: Real Life Success in the HPCC Systems Community
George S Foreman, Christopher Connelly, Jack del Vecchio, Yash Mishra, Nathalia Ribas, & Fulvio Favilla Filho, LexisNexis Risk Solutions
Join us for a moderated panel style interview with former interns who have emerged from the HPCC Systems Summer Internship Program. In this session, the next generation of technologists will share their experiences and successes working with the HPCC Systems community and learn from their experiences during their internship and how they transitioned to full time RELX employees.
ECL Training Workshop
The HPCC Systems Training and Support team has been very busy this year visiting universities and trade show events to promote HPCC Systems and ECL through Code Days, Hackathons, and Workshops. Here is this year’s Community Summit workshop:
Part 1: The “Music is Life!” Workshop
Bob Foreman, Software Engineering Lead, LexisNexis Risk Solutions
Who doesn’t love music? Take a break from your daily routine datasets and join us in this first hour. We break down a popular open-source music dataset, explore normalizing the dataset and its effects, and look at a variety of data evaluation and query techniques.