Currently we are working on a project with a client, they want to request about 200K instrument per day mainly for EOD pricing template: * What is your recommendation about the way of splitting the files ? * Will there be any delay in sending responses between the split files ? Thanks

Home
DSS

Split file in Datascope Select

Currently we are working on a project with a client, they want to request about 200K instrument per day mainly for EOD pricing template:

What is your recommendation about the way of splitting the files ?
Will there be any delay in sending responses between the split files ?

Thanks

Find more posts tagged with

#technology

Accepted answers

All comments

Jirapongse

@sarah.aoun

Thank you for reaching out to us.

Do you mean split a request or split an extracted file? I am not sure if an extracted file (output) can be spitted.

You can check the Extraction Limits by Report Template and LSEG DataScope Select Best Practices & Fair Usage Policy.

Whether a single bulk request should be split into multiple requests depends on the needs of the application. For example, according to the Extraction Limits by Report Template, the EOD Pricing report supports up to 75,000 instruments before file code and chain expansion, and up to 250,000 instruments after expansion. This means it can process 200,000 instruments in a single request, but the server may take a significant amount of time to extract all of them. As a result, the application may become temporarily unresponsive, making such large requests more suitable for backend processing.

To improve application responsiveness, you can split a single bulk request into multiple smaller requests, allowing the application to display data as each extraction completes. However, this approach is constrained by the Queueing and Concurrent Processing limits defined in the LSEG DataScope Select Best Practices & Fair Usage Policy. In addition, the total elapsed time for one large request is generally faster than submitting multiple smaller requests.

sarah.aoun

HI,

Many thanks for your response, currently we need the client want to set up the extraction in DSS for a scope of 200K instruments, and is asking for the recommendation, this doesnt mean that they want to extract full universe, just want to ensure if the split is best if we confirm that there will be no delay in sending responses between the split files.

thanks

Jirapongse

@sarah.aoun

Therefore, the client would like to use multiple requests.

Please check the the Queueing and Concurrent Processing limits defined in the LSEG DataScope Select Best Practices & Fair Usage Policy.

The extractions could be delayed by the Queueing and Concurrent Processing limits.

sarah.aoun

Hi ,

Many thanks for your help

i was checking the document Best Practices, in Structuring Extraction Request – Quick Reference, it is indicated Concurrent Extraction Processing Limit = 2 for example, what does it mean?

thanks

Jirapongse

The system allows a maximum of two extraction jobs to be processed at the same time. If an application submits more than two extraction requests simultaneously, only two will run in parallel, while the remaining requests will be placed in a queue until one of the running jobs finishes.

sarah.aoun

That's clear !! i i guess we have covered all the questions !

Thank you for your assistance and for your time, very kind of you.

EXPLORE OUR SITES