Exporting 100k Records - PAR?

Ryan S
Mega Sage

With the switch to Platform Analytics and classic reports being deprecated, how should we plan to schedule an export of 100k records? We need it scheduled to send via email and PAR doesn't let us export to csv.

2 REPLIES 2

Dr Atul G- LNG
Tera Patron

Hi @Ryan S 

Exporting or sending 100K records via email is not allowed. To do this, you would need to change the export compatibility and consider the current setup, but this could impact system performance.

*************************************************************************************************************
If my response proves useful, please indicate its helpfulness by selecting " Accept as Solution" and " Helpful." This action benefits both the community and me.

Regards
Dr. Atul G. - Learn N Grow Together
ServiceNow Techno - Functional Trainer
LinkedIn: https://www.linkedin.com/in/dratulgrover
YouTube: https://www.youtube.com/@LearnNGrowTogetherwithAtulG
Topmate: https://topmate.io/dratulgrover [ Connect for 1-1 Session]

****************************************************************************************************************

tiagomacul
Giga Sage

The guidance provided by @Dr Atul G- LNG  is absolutely correct and aligns with core platform protection principles.

 

Attempting to bypass OOB limits to send 100k records via email is not just a technical challenge; it is a significant risk to system performance and operational stability.

 

From an Enterprise Architecture perspective, the following strategies are recommended to move beyond this limitation:

 

1. Validating the 'Performance First' Mindset As correctly noted, changing export compatibility to allow such high volumes via SMTP can impact the email node and overall instance responsiveness. In the context of Digital Transformation, an architect's role is to protect the platform's long-term health while enabling business outcomes.

 

2. Modern Alternatives for High-Volume Data Instead of forcing a legacy email-based export, the recommended 'TO-BE' state involves more resilient methods:

  • Export Sets: This is the OOB standard for large datasets. It allows for scheduled exports to a MID Server, avoiding email size limitations and performance hits. * Table API or IDR: For organizations moving toward a mature data strategy, utilizing APIs or Instance Data Replication (IDR) to feed external BI tools (like PowerBI or Tableau) is the most scalable approach.

 

3. Strategic Governance Insight In the Now Create methodology, implementations should be Value-Oriented.

  • Signal vs. Noise: 100k records in a CSV often indicate that users are performing data manipulation outside of ServiceNow.

  • The Goal: Shift the culture from 'spreadsheet-led management' to 'in-platform insights' using Platform Analytics (PAR) dashboards. This ensures a 'Single Source of Truth' where data remains governed and secure.

 

Summary: While the deprecation of classic reports might seem like a hurdle, it is actually the perfect moment to retire 'Technical Debt'—like high-volume email exports—and adopt modern data consumption patterns.

 

For those looking to align their analytics and data strategies with official architectural pillars, the Now Create methodology offers a structured roadmap: ServiceNow Now Create: Practical Methodology"