(GDPR)Managing Dynamics CRM Data Retention Policy With Bulk Record Deletion

Thank you for taking time to read this post.  I am a Microsoft Dynamics Certified Professional.I am not a lawyer so l am not making conclusions but pointing out key GDPR considerations
This means that organisations should remove information pertaining to data subjects when:

• There is no further requirement to do so, either contractually or legally (i.e. they are no longer required to as part of a statutory instrument)

• The subject has withdrawn their consent

• It has been identified that data is being held which is at odds with an organisations policies or primary business activities

Article 5 extends this further by making it clear that data which you are unable to keep sufficiently accurate should be “erased…without delay”. To avoid this scenario would require the need to regularly contact the data subject concerned to verify their details are correct. One of the major “get out of jail free” cards that GDPR provides surrounding data retention is in instances where the data will be used as part of “archiving purposes in the public interest, scientific or historical research purposes or statistical purposes..” (Article 5). The scope of this is, as you can tell, rather limited and most non-governmental organisations/businesses may struggle to demonstrate their data archiving is in line with these broad principals.

The importance of ensuring a clearly defined and structured process for the removal of customer data, therefore, becomes a paramount concern under GDPR. Investigating and defining your organization’s data retention periods is an exercise that should be carried out if it has not been done so already. Once implemented, we can then turn to a component within CRM/D365 to automate and streamline the actual process – the Bulk Record Deletion feature. (Check the technet article for further guidance) https://technet.microsoft.com/library/dn531072.aspx
In a nutshell, this feature is a really efficient means of deleting large amounts of predefined data within CRM/D365. Administrators of the application will most often work with them when attempting to reduce the storage footprint of a CRM/D365 instance, via the removal of completed System Job records and other superfluous record types. The ability to define filter criteria, re-occurrence settings and to send out email notifications upon completion of a job, make them an excellent candidate to consider when streamlining your internal processes surrounding data retention.

For example, let’s assume your business has implemented a data retention policy that states Contact entity data that has not been updated or changed within 12 months should be deleted from the system. Setting up a Bulk Record Deletion Job within the application to assist with this task is remarkably straightforward, as the step-by-step guide below indicates:
1. Within the application, navigate to Settings -> Data Management on the Sitemap and click the icon to navigate to the Data Management page:

2. On the Data Management page, click on the Bulk Record Deletion icon to open the All Bulk Deletion Systems Jobs view. Once this has loaded, click on the New icon:

3. The Bulk Deletion Wizard will open a pop-up window. Click Next on the first screen to move to the Define Search Criteria window. Modify the settings as follows:
o Look for: Contact

o Search Criteria: Modified On Older Than 365 Days

   Click Next when you are ready to navigate to open the Select Options page. Give the Bulk Record Deletion Job a descriptive name and then ensure that the following settings are configured:

o Specify whether the Job should run immediately or in the future. It is recommended to schedule Jobs out of peak hours to prevent any performance detriment to other users.

o Ensure that the Run this job after every box is ticked and then select an appropriate time period. I would recommend 30 days.

o Ensure that the Send an email to me… box is ticked. You can also (optionally) specify additional email recipients, but note that these have to be valid application users (i.e. not any other email enabled entity such as Contact, Account etc.)
1. The final step in the wizard gives you the opportunity to review all configured settings. Press Submit to create the Job in the system and, if specified to start immediately, begin running it in the background. You can also navigate to the Recurring Bulk Deletion System Jobs view at any time to review the current status of a job, check to see when it is next scheduled to run or even modify its properties to suit your requirements:

A simple example is as below

• Create a custom entity to store contractual/statutory data retention limits and link these to your common entities within the application via a 1:N relationship. Once selected when a record is created, you can then define a workflow with a wait condition that updates a Two Option custom field on the entity as a flag for a Bulk Delete Job to remove from the system.

• Using a custom field on your entity to indicate that a customer has expressed their “right to be forgotten”, define a workflow that sends a customer confirmation that their details will be removed from the system within 30 days and then use this same field as a flag for a Bulk Record Deletion Job.

• Define a workflow that sends an email to owners of records that have not been modified within a set period (i.e. are inaccurate), prompting them to speak to the customer to update their details. Records that are not updated would then be deleted, using a Job similar to the one above.

Autonumbering in D365

https://www.encorebusiness.com/blog/dynamics-crm-auto-number-entities/

https://community.dynamics.com/crm/b/razdynamicscrmconsultant/archive/2016/01/17/free-autonumber-solution-for-microsoft-dynamics-crm

https://community.dynamics.com/enterprise/b/dynamics365fordevelopers/archive/2017/10/02/native-dynamics-365-v9-auto-number-solution-for-custom-entities

http://celedonpartners.com/blog/celedon-autonumber-solution-for-dynamics-crm/

Working version: https://crm2015autonumber.codeplex.com/

Summit EMEA Dublin 2018

Summit EMEA is the User Group conference that brings Microsoft Dynamics 365, AX and CRM users, industry experts and software development vendors together to discuss important issues, to learn about product updates, and to find genuine solutions that suit your business needs.

The next event will take place in the Convention Centre Dublin between 24-26 April 2018.

This is a great opportunity to share your valuable knowledge and experience with the community. If you are not able to speak we also welcome your idea on what content you would be interested in seeing. You can submit your proposal to speak or ideas using our survey portal.

Please align your submission to one of the tracks below.

Please note deadline for submission is 30th Nov 2017.

Description of data integration’ session

I would describe a data integration’ session in following way:
 
—————–Beginning of Session—Engagement-15min——————————————-
– Tell my story and my journey with dynamics crm (5min) – audience engagement 
– Present clearly a goal of my presentation and agenda (5min) – audience engagement 
– Simple questions to audience about data integration (5min) – audience engagement (optional)
———————————————————————————————
 
————-Concept-10min——————————————————————————-
– Explain a concept of SSIS and Kingswaysoft to resolve data integration to/with Dynamics CRM
– Give 3 examples (scenarios) 
– Present good practice solution and diagrams
– Summaries of typical problems and challenges in CRM’ data integration
—————————————————————————————————————
 
——————-Live-demo-10min—————————————— 
– Play Live demo 
– Replay Live demo or retrospection (optional)
– Archiving and Error Handling at data integration
——————————————————————————–
 
——————-Interactive end of Session-20min-——————————————–
– Time for Questions (10min)
– Quick Quiz about data integration (5min) (optional)
– Anonymous survey for attendees what was good and to improve in my presentation (5min)
——————————————————————————————————
5min buffer 

Solving Dynamics 365 Integration Scenarios with KingswaySoft and SSIS

Let me introduce very popular data integration’ scenario. The purpose of this presentation is an introduction a concept of CRM data integration based on Student Information System(SIS) – popular and interesting scenario. The thing is, many UK and Ireland’ universities have successfully implemented Microsoft Dynamics 365 – CRM. It is very interesting how they can take advantage of Dynamics CRM, KingswaySoft and SSIS. Based on my experience it is the best possible example to tell compelling story about CRM  data integration. Following concept keeps everything simple and really goes to the point.

1. Main points :

– Following solution was designed to provide an integration solution for passing data from/to Dynamics CRM from/to Student record System (including UCAS)

– As updates are made to the Student Information System(SIS), the updated record are written to an Intermediary Database(ID)

– Updates are periodically collected  from the Intermediary Database(ID) and written to Dynamics CRM

– As updates made to integrated records in Dynamics CRM, the updated record are written to the Intermediary Database

– Updates are periodically collected from the Intermediary Database(ID) and written to the Student Information System(SIS).

– Good data integration solution should be possible generic so config entities for data integration are implemented at CRM

– Solution covers an error handling and archiving as well

2. Daily Integration Steps
2. 1.    Collect the integration mappings configuration (config entities) from CRM

2.2.    Send Applicant data from the Intermediary Database(ID) to CRM for all applicants that are flagged as “dirty”. Dirty means that the records has been updated since it was last read (by the integration).

2.3.    Set the Applicants successfully written to CRM as not dirty.
2.4.    Read the integration last started date from CRM.
2.5.    Write the integration last started date to CRM.
2.6.    Send the following sets of data to CRM where the items are flagged as dirty (unsure?). For each Entity, set the successfully written rows as not dirty.
–    Applicants (contacts at CRM)
–    Applications (opportunities at CRM)
–    Documents
–    Form Qualification
–    Entry Qualifications
–    Clearance Checks
–    UCAS Choices
–    Communications