Throughput between CC and IHEP

The throughput for the network is worse in the direction IHEP-to-CC than for CC-to-IHEP.

There seems to be however related with a more general problem: Jérôme is investigating with RENATER for US and japanese Tier2s. There could be something wrong with the GEANT backbone. Japanes have observed different throughput with European Tier1s. Transfers with France and UK are worse than with CERN, Spain or Italy. Investigation still going on.

Perfsonar Setup and Monitoring

Perfsonar is setup on both sides at IHEP and at CC. there are tests every 4 hours for 60 seconds. However, tests between IHEP and CC are inactive since november the 28th as can be seen on the CC- personar graphs page:
https://ccperfsonar-lhcopn.in2p3.fr/serviceTest/index.cgi?eventType=bwctl
Is it a firewall problem or something else?
For information, the Tier1 perfsonars dashboard is under: https://130.199.185.78:8443/exda/?page=25&cloudName=LHCOPN

Network data analysis

Shan has setup the tools to extract the collected data by the router and store them in text format. Fabio and Shan are exploring 2 ways of storing them for high-throuhput analysis: one is using a Hadoop cluster and the other is using Redis, an in-memory key-value store. Currently they are developing the necessary tools to make some tests using real sample data in order to draw conclusions regarding the best way to store and summarize the collected data. The problem of graphical visualization of the summarized data has not been addressed yet.

David is providing the FTS log files through an Apache server every 15 minutes. The data is stored for 11 consecutive days. The logs can be found in http://cclcgftmli02.in2p3.fr/transferlogs
The idea is to cross check the activity at the level of the router with the activity shown in the logs of FTS.

Actions

- continue investigation on degraded performance of the network between CC and remote sites.
- Why no more tests of perfsonar since 28th of November?
- Continue setting up of the analysis of the routers data and later cross checks with FTS data.