You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-10 - 06:07
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5.osadl.org (updated Thu Jul 10, 2025 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2622599310,30cyclictest21778-21basename22:25:011
2622799300,29cyclictest10976-21awk23:10:013
26226993028,1cyclictest609-21dbus-daemon00:20:012
26227992928,1cyclictest18246-21apt-get23:25:113
26227992927,1cyclictest9331-21munin-run00:15:013
2622799290,28cyclictest0-21swapper/320:05:133
2622799290,1cyclictest0-21swapper/323:45:013
2622699290,28cyclictest24693-21apt-get22:30:162
2622599290,28cyclictest7268-21apt-get00:10:141
2622599290,28cyclictest0-21swapper/121:55:151
2622599290,1cyclictest2585-21apt-get00:00:121
2622599290,1cyclictest0-21swapper/119:20:131
26224992927,1cyclictest18273-21munin-run21:10:000
26224992927,1cyclictest16291-21cron00:30:010
26227992828,0cyclictest0-21swapper/320:55:123
26227992827,1cyclictest615-21rs:main3
2622799280,27cyclictest0-21swapper/300:20:123
2622799280,0cyclictest0-21swapper/323:15:163
2622699280,28cyclictest0-21swapper/220:30:122
2622699280,27cyclictest22360-21apt-get22:25:112
2622699280,1cyclictest15663-21apt-get19:55:142
2622599280,1cyclictest0-21swapper/121:45:111
26224992827,1cyclictest13076-21perf19:50:010
26224992826,1cyclictest0-21swapper/020:05:020
2622499280,28cyclictest0-21swapper/020:40:110
26227992727,0cyclictest7434-21apt-get21:55:153
26227992727,0cyclictest25525-21apt-get21:25:123
26227992725,1cyclictest31726-21cron20:29:593
26227992725,1cyclictest0-21swapper/323:50:013
26226992727,0cyclictest0-21swapper/219:25:032
2622699270,0cyclictest0-21swapper/220:45:012
26225992727,0cyclictest0-21swapper/123:40:131
26225992727,0cyclictest0-21swapper/120:35:121
26225992727,0cyclictest0-21swapper/119:55:141
26225992727,0cyclictest0-21swapper/100:15:131
2622599270,27cyclictest0-21swapper/123:35:121
2622599270,0cyclictest0-21swapper/120:20:161
26224992727,0cyclictest0-21swapper/023:45:160
26224992727,0cyclictest0-21swapper/021:55:150
26224992727,0cyclictest0-21swapper/019:55:000
26224992726,1cyclictest8939-21apt-get23:05:130
2622499270,27cyclictest0-21swapper/023:15:160
2622499270,27cyclictest0-21swapper/019:30:160
26227992626,0cyclictest0-21swapper/320:40:023
26227992626,0cyclictest0-21swapper/320:30:113
26227992626,0cyclictest0-21swapper/300:05:133
26226992626,0cyclictest0-21swapper/221:10:152
26226992626,0cyclictest0-21swapper/220:35:132
26226992626,0cyclictest0-21swapper/220:20:162
26226992626,0cyclictest0-21swapper/219:15:132
26225992626,0cyclictest1636-21apt-get22:50:131
26225992626,0cyclictest0-21swapper/123:50:101
26225992626,0cyclictest0-21swapper/121:30:151
26225992626,0cyclictest0-21swapper/100:20:131
26224992626,0cyclictest19739-21apt-get22:20:130
26224992626,0cyclictest0-21swapper/023:30:120
26224992626,0cyclictest0-21swapper/021:00:150
26224992626,0cyclictest0-21swapper/020:25:130
26224992625,1cyclictest20563-21cron21:15:000
26226992525,0cyclictest27916-21apt-get21:30:152
26226992525,0cyclictest0-21swapper/223:50:102
26226992525,0cyclictest0-21swapper/223:35:132
26225992525,0cyclictest0-21swapper/122:05:131
26225992525,0cyclictest0-21swapper/121:35:151
26225992525,0cyclictest0-21swapper/121:10:151
26225992525,0cyclictest0-21swapper/120:25:131
26224992525,0cyclictest0-21swapper/023:55:130
26224992525,0cyclictest0-21swapper/019:25:150
26224992524,1cyclictest0-21swapper/022:45:130
26227992424,0cyclictest13339-21apt-get19:50:133
26226992423,1cyclictest11551-21chrt20:55:122
26225992424,0cyclictest0-21swapper/122:40:131
26225992424,0cyclictest0-21swapper/120:55:121
26225992424,0cyclictest0-21swapper/119:50:131
26225992422,1cyclictest609-21dbus-daemon23:19:591
26225992422,1cyclictest2075-21latency_hist00:00:021
26225992422,1cyclictest0-21swapper/121:25:121
26224992424,0cyclictest0-21swapper/021:35:010
26227992323,0cyclictest0-21swapper/321:40:123
26227992322,1cyclictest10734-21cron19:45:013
26226992323,0cyclictest0-21swapper/223:00:022
26226992323,0cyclictest0-21swapper/221:00:152
26226992323,0cyclictest0-21swapper/200:30:142
26226992321,1cyclictest24718-21munin-run20:15:002
26225992323,0cyclictest0-21swapper/119:35:151
26225992321,1cyclictest303-21systemd-journal00:40:011
26225992321,1cyclictest303-21systemd-journal00:10:011
26225992321,1cyclictest24678-21cron20:15:011
26224992323,0cyclictest6613-21apt-get23:00:130
26227992222,0cyclictest27333-21apt-get20:20:163
26227992222,0cyclictest13894-21apt-get21:00:143
26227992222,0cyclictest0-21swapper/322:25:113
26226992220,1cyclictest9514-21munin-run21:59:592
26225992222,0cyclictest0-21swapper/121:00:141
26224992222,0cyclictest9780-21apt-get22:00:160
26224992222,0cyclictest5110-21apt-get21:50:130
26224992222,0cyclictest17391-21apt-get22:15:130
26224992222,0cyclictest0-21swapper/020:20:160
26224992221,0cyclictest0-21swapper/020:10:120
26227992121,0cyclictest0-21swapper/321:10:143
26227992119,1cyclictest30909-21sendmail-msp19:20:013
26226992121,0cyclictest0-21swapper/221:20:112
26225992121,0cyclictest32025-21apt-get20:30:121
26225992119,1cyclictest0-21swapper/119:35:011
26224992121,0cyclictest14772-21apt-get22:10:130
26224992119,1cyclictest0-21swapper/000:35:010
26227992020,0cyclictest31477-21perf22:45:013
26227992020,0cyclictest12095-21apt-get22:05:123
26227992020,0cyclictest0-21swapper/320:00:143
26227992020,0cyclictest0-21swapper/300:00:123
26227992019,1cyclictest22598-21cron23:35:003
26227992017,2cyclictest1879-21cron00:00:013
26226992020,0cyclictest0-21swapper/200:35:142
26226992019,0cyclictest11257-21apt-get23:10:112
26227991919,0cyclictest0-21swapper/321:50:133
26227991918,1cyclictest609-21dbus-daemon23:25:013
26226991919,0cyclictest0-21swapper/222:50:132
26226991919,0cyclictest0-21swapper/220:05:132
26226991919,0cyclictest0-21swapper/219:40:092
26226991918,0cyclictest0-21swapper/220:15:142
26225991919,0cyclictest0-21swapper/120:45:121
26224991918,1cyclictest8384-21cron19:40:010
26226991818,0cyclictest0-21swapper/221:45:122
26226991818,0cyclictest0-21swapper/219:20:132
26226991815,2cyclictest27568-21cron21:30:012
26225991818,0cyclictest0-21swapper/123:00:021
2622599180,11cyclictest607-21irqbalance22:33:261
26224991818,0cyclictest0-21swapper/000:05:130
26224991816,1cyclictest13626-21munin-run21:00:000
26227991717,0cyclictest4035-21apt-get19:30:153
26227991717,0cyclictest18901-21apt-get00:35:143
26226991717,0cyclictest0-21swapper/219:35:162
26226991715,1cyclictest0-21swapper/200:00:022
26225991717,0cyclictest27019-21apt-get22:35:121
26224991717,0cyclictest0-21swapper/021:40:120
26224991716,1cyclictest0-21swapper/000:15:010
2622799160,15cyclictest32121-21sed23:55:013
26226991612,3cyclictest303-21systemd-journal20:50:012
26225991616,0cyclictest0-21swapper/121:15:121
26225991616,0cyclictest0-21swapper/119:40:101
26225991616,0cyclictest0-21swapper/119:15:131
26225991614,1cyclictest6640-21perf20:45:011
26225991614,1cyclictest17514-21grep23:20:201
2622599160,15cyclictest21231-21memory20:05:171
2622599160,15cyclictest10826-21ntp_states22:00:211
26224991614,1cyclictest0-21swapper/022:25:170
2622499160,15cyclictest3796-21munin-run22:55:010
26227991515,0cyclictest0-21swapper/322:50:123
2622799150,14cyclictest32147-21hddtemp_smartct19:20:163
2622799150,14cyclictest10633-21ntp_states00:15:183
2622799150,14cyclictest0-21swapper/319:25:213
26226991515,0cyclictest0-21swapper/223:45:012
26226991514,1cyclictest3935-21switchtime00:00:202
26226991514,1cyclictest20859-21apt-get21:15:122
26226991513,1cyclictest13958-21cron00:25:012
26226991513,1cyclictest0-21swapper/223:25:162
2622699150,14cyclictest5847-21memory00:05:172
2622699150,14cyclictest0-21swapper/223:05:132
2622699150,14cyclictest0-21swapper/219:50:142
26225991515,0cyclictest0-21swapper/119:45:141
26225991515,0cyclictest0-21swapper/119:10:131
26224991515,0cyclictest0-21swapper/023:20:120
2622499150,1cyclictest27439-21df_inode22:35:140
2622499150,1cyclictest25112-21df_inode22:30:180
2622499150,14cyclictest0-21swapper/000:00:130
2622799140,14cyclictest0-21swapper/323:35:003
2622799140,14cyclictest0-21swapper/323:11:593
2622799140,14cyclictest0-21swapper/322:55:103
2622799140,14cyclictest0-21swapper/322:45:413
2622799140,14cyclictest0-21swapper/322:36:083
2622799140,14cyclictest0-21swapper/322:20:083
2622799140,14cyclictest0-21swapper/322:16:323
2622799140,14cyclictest0-21swapper/322:12:003
2622799140,14cyclictest0-21swapper/321:35:533
2622799140,14cyclictest0-21swapper/321:21:123
2622799140,14cyclictest0-21swapper/321:15:553
2622799140,14cyclictest0-21swapper/321:07:253
2622799140,14cyclictest0-21swapper/320:11:403
2622799140,14cyclictest0-21swapper/319:35:563
2622799140,14cyclictest0-21swapper/319:11:433
2622799140,14cyclictest0-21swapper/300:32:113
2622799140,0cyclictest0-21swapper/321:45:133
2622799140,0cyclictest0-21swapper/321:30:073
2622799140,0cyclictest0-21swapper/320:51:343
2622799140,0cyclictest0-21swapper/320:45:293
2622799140,0cyclictest0-21swapper/320:35:293
2622799140,0cyclictest0-21swapper/319:56:293
2622799140,0cyclictest0-21swapper/300:25:023
26226991414,0cyclictest0-21swapper/223:30:552
26226991414,0cyclictest0-21swapper/223:15:062
26226991414,0cyclictest0-21swapper/222:46:032
26226991414,0cyclictest0-21swapper/221:40:292
26226991413,0cyclictest0-21swapper/222:05:142
2622699140,14cyclictest0-21swapper/223:47:122
2622699140,14cyclictest0-21swapper/223:21:022
2622699140,14cyclictest0-21swapper/222:55:462
2622699140,14cyclictest0-21swapper/222:41:012
2622699140,14cyclictest0-21swapper/222:39:372
2622699140,14cyclictest0-21swapper/222:22:522
2622699140,14cyclictest0-21swapper/222:12:192
2622699140,14cyclictest0-21swapper/221:50:172
2622699140,14cyclictest0-21swapper/221:35:022
2622699140,14cyclictest0-21swapper/221:08:052
2622699140,14cyclictest0-21swapper/220:52:442
2622699140,14cyclictest0-21swapper/219:48:082
2622699140,14cyclictest0-21swapper/200:25:262
2622699140,14cyclictest0-21swapper/200:10:452
2622699140,0cyclictest0-21swapper/222:15:202
2622699140,0cyclictest0-21swapper/222:01:222
2622699140,0cyclictest0-21swapper/219:31:292
26225991414,0cyclictest0-21swapper/123:25:111
26225991414,0cyclictest0-21swapper/122:47:261
26225991414,0cyclictest0-21swapper/122:25:111
26225991414,0cyclictest0-21swapper/120:50:321
26225991414,0cyclictest0-21swapper/100:30:321
2622599140,14cyclictest0-21swapper/123:30:151
2622599140,14cyclictest0-21swapper/123:11:381
2622599140,14cyclictest0-21swapper/123:05:081
2622599140,14cyclictest0-21swapper/122:15:071
2622599140,14cyclictest0-21swapper/122:10:541
2622599140,14cyclictest0-21swapper/121:50:541
2622599140,14cyclictest0-21swapper/121:41:341
2622599140,14cyclictest0-21swapper/121:22:191
2622599140,14cyclictest0-21swapper/119:25:361
2622599140,0cyclictest0-21swapper/123:45:041
2622599140,0cyclictest0-21swapper/122:55:431
2622599140,0cyclictest0-21swapper/121:05:121
2622599140,0cyclictest0-21swapper/120:19:181
26224991414,0cyclictest0-21swapper/023:25:200
26224991414,0cyclictest0-21swapper/022:40:390
26224991414,0cyclictest0-21swapper/019:13:050
26224991413,1cyclictest12529-21which23:10:180
2622499140,14cyclictest9775-21/usr/sbin/munin20:50:140
2622499140,14cyclictest0-21swapper/023:50:010
2622499140,14cyclictest0-21swapper/023:41:280
2622499140,14cyclictest0-21swapper/022:57:200
2622499140,14cyclictest0-21swapper/021:30:130
2622499140,14cyclictest0-21swapper/021:26:390
2622499140,14cyclictest0-21swapper/021:20:260
2622499140,14cyclictest0-21swapper/020:46:090
2622499140,14cyclictest0-21swapper/020:36:050
2622499140,14cyclictest0-21swapper/020:31:340
2622499140,14cyclictest0-21swapper/019:56:310
2622499140,14cyclictest0-21swapper/000:21:290
2622499140,14cyclictest0-21swapper/000:15:480
2622499140,0cyclictest0-21swapper/023:35:130
2622499140,0cyclictest0-21swapper/021:45:320
2622499140,0cyclictest0-21swapper/021:19:100
2622499140,0cyclictest0-21swapper/020:15:440
2622499140,0cyclictest0-21swapper/020:06:530
2622499140,0cyclictest0-21swapper/019:40:150
2622499140,0cyclictest0-21swapper/019:20:020
2622499140,0cyclictest0-21swapper/019:15:360
2622499140,0cyclictest0-21swapper/000:35:460
26227991313,0cyclictest0-21swapper/319:46:163
2622799130,13cyclictest0-21swapper/320:15:323
2622799130,0cyclictest0-21swapper/322:31:253
26226991313,0cyclictest0-21swapper/220:25:042
26226991313,0cyclictest0-21swapper/220:00:112
26226991313,0cyclictest0-21swapper/219:12:092
26225991313,0cyclictest0-21swapper/120:00:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional