You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-25 - 12:54
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot3.osadl.org (updated Thu Jul 25, 2024 00:43:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
268245599120,11cyclictest0-21swapper/320:35:143
268245599110,11cyclictest0-21swapper/323:30:113
268245599110,11cyclictest0-21swapper/322:50:123
268245599110,11cyclictest0-21swapper/321:50:013
268245599110,11cyclictest0-21swapper/321:10:133
268245599110,11cyclictest0-21swapper/319:15:103
268245599110,10cyclictest0-21swapper/322:15:123
268245599110,0cyclictest0-21swapper/323:50:103
268245599110,0cyclictest0-21swapper/323:45:113
268245599110,0cyclictest0-21swapper/320:55:193
2682455991010,0cyclictest0-21swapper/321:27:193
2682455991010,0cyclictest0-21swapper/321:15:293
2682455991010,0cyclictest0-21swapper/320:50:123
2682455991010,0cyclictest0-21swapper/319:35:113
268245599100,10cyclictest0-21swapper/323:40:173
268245599100,10cyclictest0-21swapper/323:35:183
268245599100,10cyclictest0-21swapper/321:50:253
268245599100,10cyclictest0-21swapper/320:15:223
268245599100,10cyclictest0-21swapper/320:10:203
268245599100,10cyclictest0-21swapper/319:40:183
268245599100,0cyclictest0-21swapper/323:15:193
268245599100,0cyclictest0-21swapper/321:41:213
268245599100,0cyclictest0-21swapper/321:20:123
268245599100,0cyclictest0-21swapper/320:30:103
268245599100,0cyclictest0-21swapper/320:20:113
268245599100,0cyclictest0-21swapper/320:00:113
268245599100,0cyclictest0-21swapper/300:00:003
26824559999,0cyclictest0-21swapper/322:45:113
26824559999,0cyclictest0-21swapper/300:40:023
26824559999,0cyclictest0-21swapper/300:20:123
26824559990,9cyclictest0-21swapper/322:45:003
2716105280,0sleep12716131-21apt-get20:35:141
26824559988,0cyclictest0-21swapper/322:07:323
26824559988,0cyclictest0-21swapper/321:05:013
26824559988,0cyclictest0-21swapper/320:40:223
26824559988,0cyclictest0-21swapper/319:30:093
26824559980,0cyclictest0-21swapper/323:05:013
26824559980,0cyclictest0-21swapper/322:15:013
26824559977,0cyclictest0-21swapper/323:13:253
26824559977,0cyclictest0-21swapper/322:29:293
26824559977,0cyclictest0-21swapper/321:56:333
26824559977,0cyclictest0-21swapper/321:34:353
26824559977,0cyclictest0-21swapper/320:25:183
26824559977,0cyclictest0-21swapper/320:06:433
26824559977,0cyclictest0-21swapper/319:53:133
26824559977,0cyclictest0-21swapper/319:25:133
26824559977,0cyclictest0-21swapper/319:22:473
26824559977,0cyclictest0-21swapper/319:11:483
26824559977,0cyclictest0-21swapper/300:19:203
26824559977,0cyclictest0-21swapper/300:08:213
24942239870,3rtkit-daemon0-21swapper/119:08:171
26824559966,0cyclictest0-21swapper/323:20:103
26824559966,0cyclictest0-21swapper/322:20:013
26824559966,0cyclictest0-21swapper/319:55:443
26824559966,0cyclictest0-21swapper/300:30:193
26824559960,6cyclictest0-21swapper/323:00:003
26824559960,0cyclictest0-21swapper/322:33:213
2682034261,4sleep30-21swapper/319:06:353
26824559951,2cyclictest0-21swapper/319:45:113
26824559950,1cyclictest27418922sleep321:38:183
24942239850,3rtkit-daemon538-21systemd-logind22:12:300
26824559944,0cyclictest0-21swapper/300:10:273
26824559940,3cyclictest0-21swapper/323:05:393
26824559940,3cyclictest0-21swapper/322:38:283
26824559940,3cyclictest0-21swapper/300:02:033
26824559940,0cyclictest0-21swapper/323:25:163
26824559940,0cyclictest0-21swapper/321:05:143
2682292240,1sleep00-21swapper/019:09:560
2682217240,1sleep20-21swapper/219:08:582
24942239840,2rtkit-daemon717-21lldpd22:40:110
24942239840,2rtkit-daemon717-21lldpd21:43:220
24942239840,2rtkit-daemon617-21gmain21:00:111
24942239840,2rtkit-daemon2805771-21systemd-run00:10:020
24942239840,2rtkit-daemon2740662-21df21:35:171
24942239840,2rtkit-daemon2711638-21users20:20:211
24942239840,2rtkit-daemon1-21systemd23:49:480
24942239840,1rtkit-daemon717-21lldpd23:11:180
24942239840,1rtkit-daemon717-21lldpd19:48:271
24942239840,1rtkit-daemon617-21gmain00:00:400
24942239840,1rtkit-daemon539-21wpa_supplicant23:23:020
24942239840,1rtkit-daemon3191333-21snmpd22:17:430
24942239840,1rtkit-daemon2733912-21apt-get21:20:121
2782909230,1sleep02782925-21apt-get23:15:010
2722865230,2sleep02723095-21sshd20:50:220
2686940230,1sleep02686966-21apt-get19:20:090
26824559933,0cyclictest0-21swapper/322:00:073
26824559933,0cyclictest0-21swapper/320:45:073
26824559933,0cyclictest0-21swapper/300:25:283
24942239830,2rtkit-daemon3191333-21snmpd23:00:200
24942239830,1rtkit-daemon717-21lldpd20:46:451
24942239830,1rtkit-daemon717-21lldpd19:32:561
24942239830,1rtkit-daemon717-21lldpd00:15:050
24942239830,1rtkit-daemon539-21wpa_supplicant20:55:041
24942239830,1rtkit-daemon539-21wpa_supplicant00:12:240
24942239830,1rtkit-daemon534-21rsyslogd23:30:080
24942239830,1rtkit-daemon3191333-21snmpd00:27:120
24942239830,1rtkit-daemon2729363-21diskmemload22:46:370
24942239830,1rtkit-daemon2729363-21diskmemload21:26:381
24942239830,1rtkit-daemon2695959-21sshd19:40:221
24942239830,1rtkit-daemon2684531-21munin-node23:07:520
24942239830,1rtkit-daemon2684531-21munin-node21:58:000
24942239830,1rtkit-daemon2684531-21munin-node19:20:031
24942239830,1rtkit-daemon2498081-21packagekitd22:05:170
24942239830,1rtkit-daemon2494222-21sendmail-mta20:14:271
24942239830,1rtkit-daemon2494222-21sendmail-mta00:33:460
24942239830,1rtkit-daemon2489622-21systemd-journal20:44:561
24942239830,1rtkit-daemon1-21systemd23:55:540
24942239830,1rtkit-daemon1-21systemd23:50:410
24942239830,1rtkit-daemon1-21systemd23:41:270
24942239830,1rtkit-daemon1-21systemd23:35:410
24942239830,1rtkit-daemon1-21systemd23:26:230
24942239830,1rtkit-daemon1-21systemd22:58:320
24942239830,1rtkit-daemon1-21systemd22:39:370
24942239830,1rtkit-daemon1-21systemd22:27:090
24942239830,1rtkit-daemon1-21systemd22:22:430
24942239830,1rtkit-daemon1-21systemd21:41:271
24942239830,1rtkit-daemon1-21systemd21:30:341
24942239830,1rtkit-daemon1-21systemd20:50:201
24942239830,1rtkit-daemon1-21systemd20:32:281
24942239830,1rtkit-daemon1-21systemd19:25:261
24942239830,1rtkit-daemon1-21systemd00:35:590
24942239830,1rtkit-daemon1-21systemd00:21:250
24942239830,1rtkit-daemon0-21swapper/119:15:011
24942239830,0rtkit-daemon0-21swapper/121:14:361
24942239830,0rtkit-daemon0-21swapper/121:05:281
24942239830,0rtkit-daemon0-21swapper/120:28:261
24942239830,0rtkit-daemon0-21swapper/022:51:150
24942239830,0rtkit-daemon0-21swapper/022:00:160
2806063220,0sleep10-21swapper/100:10:501
2796820220,1sleep20-21swapper/223:45:122
2781081220,1sleep20-21swapper/223:10:152
2781061220,0sleep12781078-21apt-get23:10:141
2780546220,0sleep10-21swapper/123:07:541
2775426220,1sleep10-21swapper/122:55:171
2772657220,1sleep12772717-21aten_r1power_po22:50:131
2771604220,1sleep22771768-21ssh22:45:222
2766437220,1sleep12766639-21diskstats22:35:161
2763518220,0sleep20-21swapper/222:27:212
2760863220,1sleep22759855-21/usr/sbin/munin22:20:202
2759854220,1sleep12759910-21aten_r1power_cu22:20:111
2746379220,1sleep10-21swapper/121:50:021
2743497220,1sleep22743676-21/usr/sbin/munin21:40:222
2735621220,0sleep00-21swapper/021:23:550
2735471220,0sleep20-21swapper/221:22:372
2731409222,0sleep00-21swapper/021:14:270
2717610220,0sleep00-21swapper/020:37:530
2713931220,1sleep02714151-21latency_hist20:30:000
2712255220,0sleep22712281-21apt-get20:25:102
2705151220,1sleep22705298-21ntpq20:05:172
2704921220,0sleep00-21swapper/020:05:150
2701378220,1sleep02701512-21sort19:55:190
2696681220,1sleep02696767-21grep19:45:140
2696118221,1sleep014-21ksoftirqd/019:42:180
24942239820,1rtkit-daemon2498081-21packagekitd19:55:171
24942239820,1rtkit-daemon2494222-21sendmail-mta19:36:071
24942239820,1rtkit-daemon1-21systemd21:15:061
24942239820,1rtkit-daemon1-21systemd20:16:161
24942239820,0rtkit-daemon0-21swapper/120:05:131
24942239820,0rtkit-daemon0-21swapper/120:00:171
24942239820,0rtkit-daemon0-21swapper/119:50:241
24942239820,0rtkit-daemon0-21swapper/119:15:141
24942239820,0rtkit-daemon0-21swapper/022:31:260
24942239820,0rtkit-daemon0-21swapper/021:50:110
24942239820,0rtkit-daemon0-21swapper/021:45:400
2811662210,0sleep20-21swapper/200:37:402
2811390210,0sleep10-21swapper/100:35:191
2810750210,0sleep20-21swapper/200:31:482
2810348210,0sleep10-21swapper/100:30:021
2809746210,0sleep20-21swapper/200:25:072
2809508210,0sleep10-21swapper/100:25:021
2808408210,0sleep20-21swapper/200:20:192
2807370210,0sleep10-21swapper/100:20:021
2806967210,0sleep20-21swapper/200:16:342
2806555210,0sleep10-21swapper/100:15:011
2806011210,0sleep20-21swapper/200:10:232
2805419210,0sleep10-21swapper/100:07:171
2804924210,0sleep20-21swapper/200:05:022
2803051210,0sleep10-21swapper/100:00:041
2802789210,0sleep20-21swapper/200:00:012
2801004210,0sleep10-21swapper/123:55:131
2800663210,0sleep20-21swapper/223:55:022
2798889210,0sleep10-21swapper/123:50:121
2798795210,0sleep20-21swapper/223:50:092
2796745210,0sleep10-21swapper/123:45:111
2795373210,0sleep20-21swapper/223:40:172
2795324210,0sleep10-21swapper/123:40:161
2792817210,0sleep20-21swapper/223:35:172
2792176210,0sleep10-21swapper/123:35:121
2790502210,0sleep10-21swapper/123:30:141
2790096210,0sleep20-21swapper/223:30:112
2788658210,0sleep20-21swapper/223:25:202
2787698210,0sleep10-21swapper/123:25:111
2786175210,0sleep20-21swapper/223:20:162
2785553210,0sleep10-21swapper/123:20:071
2783425210,0sleep20-21swapper/223:15:112
2783409210,0sleep10-21swapper/123:15:021
2778932210,0sleep20-21swapper/223:05:112
2776817210,0sleep20-21swapper/223:00:112
2776547210,0sleep10-21swapper/123:00:011
2775514210,0sleep20-21swapper/222:55:182
2772718210,0sleep20-21swapper/222:50:142
2770575210,0sleep10-21swapper/122:45:121
2768954210,0sleep10-21swapper/122:40:171
2768574210,0sleep20-21swapper/222:40:142
2766235210,0sleep20-21swapper/222:35:132
2764209210,0sleep20-21swapper/222:30:132
2764115210,0sleep10-21swapper/122:30:111
2762226210,0sleep10-21swapper/122:25:121
2757901210,0sleep20-21swapper/222:15:162
2757832210,0sleep10-21swapper/122:15:141
2755405210,0sleep10-21swapper/122:10:111
2755327210,0sleep20-21swapper/222:10:082
2754070210,0sleep20-21swapper/222:05:242
2754037210,0sleep10-21swapper/122:05:231
2750942210,0sleep20-21swapper/222:00:142
2750875210,0sleep10-21swapper/122:00:131
2749142210,0sleep12749163-21forks21:55:181
2748707210,0sleep20-21swapper/221:55:112
2747108210,0sleep20-21swapper/221:50:192
2744914210,0sleep10-21swapper/121:45:171
2744512210,0sleep20-21swapper/221:45:142
2741306210,0sleep20-21swapper/221:35:262
2740358210,0sleep00-21swapper/021:35:160
2738549210,0sleep02738116-21/usr/sbin/munin21:30:150
2738220210,0sleep20-21swapper/221:30:132
2736233210,0sleep00-21swapper/021:25:110
2735995210,0sleep20-21swapper/221:25:092
2732367210,0sleep00-21swapper/021:15:260
2731477210,0sleep20-21swapper/221:15:002
2729601210,0sleep20-21swapper/221:10:132
2728455210,0sleep00-21swapper/021:05:540
2727676210,0sleep20-21swapper/221:05:122
2725920210,0sleep00-21swapper/021:00:130
2725754210,0sleep20-21swapper/221:00:112
2724535210,0sleep00-21swapper/020:55:180
2723812210,0sleep20-21swapper/220:55:122
2722256210,0sleep20-21swapper/220:50:162
2720843210,0sleep20-21swapper/220:45:182
2720698210,0sleep00-21swapper/020:45:160
2718722210,0sleep20-21swapper/220:40:192
2717776210,0sleep00-21swapper/020:40:010
2716134210,0sleep20-21swapper/220:35:152
2715478210,0sleep00-21swapper/020:30:200
2714201210,0sleep20-21swapper/220:30:092
2710336210,0sleep00-21swapper/020:20:120
2710068210,0sleep20-21swapper/220:20:022
2708810210,0sleep00-21swapper/020:15:150
2708144210,0sleep20-21swapper/220:15:012
2708089210,0sleep20-21swapper/220:14:222
2706753210,0sleep00-21swapper/020:10:150
2702756210,0sleep20-21swapper/220:00:122
2702622210,0sleep00-21swapper/020:00:100
2701729210,0sleep20-21swapper/219:55:212
2699297210,0sleep20-21swapper/219:50:202
2699105210,0sleep00-21swapper/019:50:180
2696577210,0sleep20-21swapper/219:45:112
2694654210,0sleep20-21swapper/219:40:122
2692721210,0sleep20-21swapper/219:35:122
2692468210,0sleep00-21swapper/019:35:020
2691575210,0sleep00-21swapper/019:30:160
2690848210,0sleep20-21swapper/219:30:102
2690235210,0sleep00-21swapper/019:26:050
2688865210,0sleep20-21swapper/219:25:112
2687062210,0sleep20-21swapper/219:20:112
2685364210,0sleep20-21swapper/219:15:142
2685088210,0sleep00-21swapper/019:15:130
2684199210,0sleep00-21swapper/019:13:480
2682851210,0sleep20-21swapper/219:10:142
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional