cbsodataR in Remoteacces environment

[bevogt]

Dear Edwin,

thank you for developing this great package! I tried to run it in the microdata-remoteaccess environment of CBS but i could not get it running. The same code worked perfectly fine outside the environment, but it simply did not download the data (even though the URL is accessible in the environment).
Are you familiar with this problem?

Best,

Benedikt

[edwindj]

Thx! There is no internet connection in the remote access environment so the data cannot be retrieved via internet. I will check with the people of the remote environment if it is possible to have restricted access to the cbs opendata server. It helps if you do the same :-) Best, Edwin Op ma 20 jul. 2020 12:01 schreef bevogt <notifications@github.com>:

…

Dear Edwin, thank you for developing this great package! I tried to run it in the microdata-remoteaccess environment of CBS but i could not get it running. The same code worked perfectly fine outside the environment, but it simply did not download the data (even though the URL is accessible in the environment). Are you familiar with this problem? Best, Benedikt — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#26>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAEEOHEFIVFKC3OXFV6OJG3R4QIZFANCNFSM4PCDZOGA> .

[bevogt]

Hi, Yes I already asked for the access to the URL already in the environment and it was granted. But it still does not seem to work. I can forward you the email discussion. Best Benedikt

---- Sent from my mobile device. Op 20 jul. 2020 om 12:49 heeft Edwin de Jonge <notifications@github.com> het volgende geschreven:  Thx! There is no internet connection in the remote access environment so the data cannot be retrieved via internet. I will check with the people of the remote environment if it is possible to have restricted access to the cbs opendata server. It helps if you do the same :-) Best, Edwin Op ma 20 jul. 2020 12:01 schreef bevogt <notifications@github.com>:

Dear Edwin, thank you for developing this great package! I tried to run it in the microdata-remoteaccess environment of CBS but i could not get it running. The same code worked perfectly fine outside the environment, but it simply did not download the data (even though the URL is accessible in the environment). Are you familiar with this problem? Best, Benedikt — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#26>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAEEOHEFIVFKC3OXFV6OJG3R4QIZFANCNFSM4PCDZOGA> .

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub<#26 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AQK5UFYV4QMRFFHKXDWMCLLR4QOLDANCNFSM4PCDZOGA>.

…

-- ================================================================================ Dit bericht kan informatie bevatten die niet voor u is bestemd. Indien u niet de geadresseerde bent of dit bericht abusievelijk aan u is toegezonden, wordt u verzocht dat aan de afzender te melden en het bericht te verwijderen. De Staat aanvaardt geen aansprakelijkheid voor schade, van welke aard ook, die verband houdt met risico's verbonden aan het elektronisch verzenden van berichten. This message may contain information that is not intended for you. If you are not the addressee or if this message was sent to you by mistake, you are requested to inform the sender and delete the message. The State accepts no liability for damage of any kind resulting from the risks inherent in the electronic transmission of messages. ================================================================================

[bevogt]

This what was done already. But it still does not work.
Toegang vanuit een RA sessie naar de benodigde opendata URL http://opendata.cbs.nl/ODataFeed/ werkt.

Ik heb geprobeerd in R of de package werkt en dat lijkt zo te zijn:

Advies om de sessie helemaal af te sluiten en opnieuw R 3.6.2 te starten.

Indien het hierna toch niet zou werken voor de onderzoeker, kan de onderzoeker dan aangeven welke R commando's hij gebruikt?

[edwindj]

Strange... You can try the following from within the remote access environment: 1. Open a browser 2. You can check which url is executed, by adding verbose=TRUE to cbs_get_data(). Copy this url and paste in the address bar of your browser. Does that work? Alternatively: what R version are you using? Tip: sessionInfo() Op ma 20 jul. 2020 om 13:17 schreef bevogt <notifications@github.com>:

…

Hi, Yes I already asked for the access to the URL already in the environment and it was granted. But it still does not seem to work. I can forward you the email discussion. Best Benedikt ---- Sent from my mobile device. Op 20 jul. 2020 om 12:49 heeft Edwin de Jonge ***@***.***> het volgende geschreven:  Thx! There is no internet connection in the remote access environment so the data cannot be retrieved via internet. I will check with the people of the remote environment if it is possible to have restricted access to the cbs opendata server. It helps if you do the same :-) Best, Edwin Op ma 20 jul. 2020 12:01 schreef bevogt ***@***.***>: > Dear Edwin, > > thank you for developing this great package! I tried to run it in the > microdata-remoteaccess environment of CBS but i could not get it running. > The same code worked perfectly fine outside the environment, but it simply > did not download the data (even though the URL is accessible in the > environment). > Are you familiar with this problem? > > Best, > > Benedikt > > — > You are receiving this because you are subscribed to this thread. > Reply to this email directly, view it on GitHub > <#26>, or unsubscribe > < https://github.com/notifications/unsubscribe-auth/AAEEOHEFIVFKC3OXFV6OJG3R4QIZFANCNFSM4PCDZOGA> > . > — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub< #26 (comment)>, or unsubscribe< https://github.com/notifications/unsubscribe-auth/AQK5UFYV4QMRFFHKXDWMCLLR4QOLDANCNFSM4PCDZOGA>. -- ================================================================================ Dit bericht kan informatie bevatten die niet voor u is bestemd. Indien u niet de geadresseerde bent of dit bericht abusievelijk aan u is toegezonden, wordt u verzocht dat aan de afzender te melden en het bericht te verwijderen. De Staat aanvaardt geen aansprakelijkheid voor schade, van welke aard ook, die verband houdt met risico's verbonden aan het elektronisch verzenden van berichten. This message may contain information that is not intended for you. If you are not the addressee or if this message was sent to you by mistake, you are requested to inform the sender and delete the message. The State accepts no liability for damage of any kind resulting from the risks inherent in the electronic transmission of messages. ================================================================================ — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#26 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAEEOHDP3FIWST6VJJVVXZLR4QRVPANCNFSM4PCDZOGA> .

[bevogt]

I get an error message for one URL (parse error: premature EOF) - The package successfully opens three URLs before. When I copy-paste it to the browser I can open the URL and the file. The RStudio version installed is 3.6 From: Edwin de Jonge <notifications@github.com> Sent: maandag 20 juli 2020 13:35 To: edwindj/cbsodataR <cbsodataR@noreply.github.com> Cc: Benedikt Vogt <B.Vogt@cpb.nl>; Author <author@noreply.github.com> Subject: Re: [edwindj/cbsodataR] cbsodataR in Remoteacces environment (#26) Strange... You can try the following from within the remote access environment: 1. Open a browser 2. You can check which url is executed, by adding verbose=TRUE to cbs_get_data(). Copy this url and paste in the address bar of your browser. Does that work? Alternatively: what R version are you using? Tip: sessionInfo() Op ma 20 jul. 2020 om 13:17 schreef bevogt <notifications@github.com<mailto:notifications@github.com>>:

Hi, Yes I already asked for the access to the URL already in the environment and it was granted. But it still does not seem to work. I can forward you the email discussion. Best Benedikt ---- Sent from my mobile device. Op 20 jul. 2020 om 12:49 heeft Edwin de Jonge ***@***.******@***.***>> het volgende geschreven:  Thx! There is no internet connection in the remote access environment so the data cannot be retrieved via internet. I will check with the people of the remote environment if it is possible to have restricted access to the cbs opendata server. It helps if you do the same :-) Best, Edwin Op ma 20 jul. 2020 12:01 schreef bevogt ***@***.******@***.***>>: > Dear Edwin, > > thank you for developing this great package! I tried to run it in the > microdata-remoteaccess environment of CBS but i could not get it running. > The same code worked perfectly fine outside the environment, but it simply > did not download the data (even though the URL is accessible in the > environment). > Are you familiar with this problem? > > Best, > > Benedikt > > — > You are receiving this because you are subscribed to this thread. > Reply to this email directly, view it on GitHub > <#26>, or unsubscribe > < https://github.com/notifications/unsubscribe-auth/AAEEOHEFIVFKC3OXFV6OJG3R4QIZFANCNFSM4PCDZOGA> > . > — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub< #26 (comment)>, or unsubscribe< https://github.com/notifications/unsubscribe-auth/AQK5UFYV4QMRFFHKXDWMCLLR4QOLDANCNFSM4PCDZOGA>. -- ================================================================================ Dit bericht kan informatie bevatten die niet voor u is bestemd. Indien u niet de geadresseerde bent of dit bericht abusievelijk aan u is toegezonden, wordt u verzocht dat aan de afzender te melden en het bericht te verwijderen. De Staat aanvaardt geen aansprakelijkheid voor schade, van welke aard ook, die verband houdt met risico's verbonden aan het elektronisch verzenden van berichten. This message may contain information that is not intended for you. If you are not the addressee or if this message was sent to you by mistake, you are requested to inform the sender and delete the message. The State accepts no liability for damage of any kind resulting from the risks inherent in the electronic transmission of messages. ================================================================================ — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#26 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAEEOHDP3FIWST6VJJVVXZLR4QRVPANCNFSM4PCDZOGA> .

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub<#26 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AQK5UF2RUVSSUKSO5DCLIQLR4QTWRANCNFSM4PCDZOGA>.

…

-- ================================================================================ Dit bericht kan informatie bevatten die niet voor u is bestemd. Indien u niet de geadresseerde bent of dit bericht abusievelijk aan u is toegezonden, wordt u verzocht dat aan de afzender te melden en het bericht te verwijderen. De Staat aanvaardt geen aansprakelijkheid voor schade, van welke aard ook, die verband houdt met risico's verbonden aan het elektronisch verzenden van berichten. This message may contain information that is not intended for you. If you are not the addressee or if this message was sent to you by mistake, you are requested to inform the sender and delete the message. The State accepts no liability for damage of any kind resulting from the risks inherent in the electronic transmission of messages. ================================================================================

[edwindj]

Could you post the url in the github issue? Still strange that this is not working :-) Best, Edwin Op di 28 jul. 2020 om 11:50 schreef bevogt <notifications@github.com>:

…

I get an error message for one URL (parse error: premature EOF) - The package successfully opens three URLs before. When I copy-paste it to the browser I can open the URL and the file. The RStudio version installed is 3.6 From: Edwin de Jonge ***@***.***> Sent: maandag 20 juli 2020 13:35 To: edwindj/cbsodataR ***@***.***> Cc: Benedikt Vogt ***@***.***>; Author ***@***.***> Subject: Re: [edwindj/cbsodataR] cbsodataR in Remoteacces environment (#26) Strange... You can try the following from within the remote access environment: 1. Open a browser 2. You can check which url is executed, by adding verbose=TRUE to cbs_get_data(). Copy this url and paste in the address bar of your browser. Does that work? Alternatively: what R version are you using? Tip: sessionInfo() Op ma 20 jul. 2020 om 13:17 schreef bevogt ***@***.*** ***@***.***>>: > Hi, > > Yes I already asked for the access to the URL already in the environment > and it was granted. But it still does not seem to work. > > I can forward you the email discussion. > > Best > > Benedikt > > ---- > Sent from my mobile device. > > Op 20 jul. 2020 om 12:49 heeft Edwin de Jonge ***@***.*** ***@***.***>> > het volgende geschreven: > >  > > Thx! There is no internet connection in the remote access environment so > the data cannot be retrieved via internet. I will check with the people of > the remote environment if it is possible to have restricted access to the > cbs opendata server. It helps if you do the same :-) > > Best, > > Edwin > > Op ma 20 jul. 2020 12:01 schreef bevogt ***@***.*** ***@***.***>>: > > > Dear Edwin, > > > > thank you for developing this great package! I tried to run it in the > > microdata-remoteaccess environment of CBS but i could not get it > running. > > The same code worked perfectly fine outside the environment, but it > simply > > did not download the data (even though the URL is accessible in the > > environment). > > Are you familiar with this problem? > > > > Best, > > > > Benedikt > > > > — > > You are receiving this because you are subscribed to this thread. > > Reply to this email directly, view it on GitHub > > <#26>, or unsubscribe > > < > https://github.com/notifications/unsubscribe-auth/AAEEOHEFIVFKC3OXFV6OJG3R4QIZFANCNFSM4PCDZOGA> > > > . > > > > — > You are receiving this because you authored the thread. > Reply to this email directly, view it on GitHub< > #26 (comment)>, > or unsubscribe< > https://github.com/notifications/unsubscribe-auth/AQK5UFYV4QMRFFHKXDWMCLLR4QOLDANCNFSM4PCDZOGA>. > > > -- > > ================================================================================ > Dit bericht kan informatie bevatten die niet voor u is bestemd. Indien u > niet > de geadresseerde bent of dit bericht abusievelijk aan u is toegezonden, > wordt > u verzocht dat aan de afzender te melden en het bericht te verwijderen. > De Staat aanvaardt geen aansprakelijkheid voor schade, van welke aard ook, > die > verband houdt met risico's verbonden aan het elektronisch verzenden van > berichten. > > This message may contain information that is not intended for you. If you > are > not the addressee or if this message was sent to you by mistake, you are > requested to inform the sender and delete the message. The State accepts no > liability for damage of any kind resulting from the risks inherent in the > electronic transmission of messages. > > ================================================================================ > > — > You are receiving this because you commented. > Reply to this email directly, view it on GitHub > <#26 (comment)>, > or unsubscribe > < https://github.com/notifications/unsubscribe-auth/AAEEOHDP3FIWST6VJJVVXZLR4QRVPANCNFSM4PCDZOGA> > . > — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub< #26 (comment)>, or unsubscribe< https://github.com/notifications/unsubscribe-auth/AQK5UF2RUVSSUKSO5DCLIQLR4QTWRANCNFSM4PCDZOGA>. -- ================================================================================ Dit bericht kan informatie bevatten die niet voor u is bestemd. Indien u niet de geadresseerde bent of dit bericht abusievelijk aan u is toegezonden, wordt u verzocht dat aan de afzender te melden en het bericht te verwijderen. De Staat aanvaardt geen aansprakelijkheid voor schade, van welke aard ook, die verband houdt met risico's verbonden aan het elektronisch verzenden van berichten. This message may contain information that is not intended for you. If you are not the addressee or if this message was sent to you by mistake, you are requested to inform the sender and delete the message. The State accepts no liability for damage of any kind resulting from the risks inherent in the electronic transmission of messages. ================================================================================ — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#26 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAEEOHER27H3ERS6O4ND3DTR52NOTANCNFSM4PCDZOGA> .

[bevogt]

Sure. sorry.
this is where the error occurs
http://opendata.cbs.nl/ODataFeed/odata/37713/TypedDataSet?$format=json&$skip=40000

the links before with skip=10000,skip=20000,skip=30000 do not produce an error