You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-19 - 10:52
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5.osadl.org (updated Wed Nov 19, 2025 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
7489994614,0cyclictest151rcu_preempt23:58:363
7489993315,0cyclictest16982-21kworker/3:200:20:573
748899300,29cyclictest29319-21apt-get00:30:132
748599300,0cyclictest0-21swapper/122:00:161
748499300,29cyclictest17577-21cron20:39:590
7489992927,1cyclictest28763-21munin-run00:30:013
748999290,28cyclictest25796-21apt-get22:05:143
748999290,28cyclictest0-21swapper/300:05:143
7488992928,1cyclictest19417-21cron00:10:012
7488992927,1cyclictest10597-21cron20:25:012
748899290,28cyclictest26695-21apt-get00:25:142
748899290,28cyclictest20572-21apt-get20:45:142
748899290,28cyclictest0-21swapper/200:15:152
7485992927,1cyclictest2960-21cron23:35:011
748599290,28cyclictest6500-21sh21:25:001
748599290,28cyclictest0-21swapper/121:45:141
748499290,28cyclictest0-21swapper/023:45:010
748999280,27cyclictest0-21swapper/321:10:123
748999280,0cyclictest15543-21apt-get20:35:143
7488992828,0cyclictest6214-21apt-get20:15:182
748899280,28cyclictest0-21swapper/221:15:142
748499285,23cyclictest11645-21kworker/0:221:59:580
7484992828,0cyclictest0-21swapper/021:30:150
7484992827,0cyclictest22026-21apt-get00:15:150
7484992826,1cyclictest0-21swapper/022:20:000
748499280,27cyclictest0-21swapper/020:55:140
748499280,0cyclictest0-21swapper/023:00:150
7489992727,0cyclictest0-21swapper/300:30:023
748999270,0cyclictest0-21swapper/319:20:153
7488992727,0cyclictest0-21swapper/219:25:142
748899270,27cyclictest0-21swapper/221:55:132
7485992727,0cyclictest0-21swapper/122:55:141
7485992727,0cyclictest0-21swapper/121:00:131
7485992727,0cyclictest0-21swapper/120:45:141
7485992727,0cyclictest0-21swapper/100:05:011
7484992727,0cyclictest326-21apt-get22:20:140
7484992727,0cyclictest0-21swapper/022:55:130
7484992727,0cyclictest0-21swapper/020:15:160
7489992626,0cyclictest0-21swapper/322:20:153
7488992626,0cyclictest0-21swapper/222:05:142
7488992626,0cyclictest0-21swapper/221:05:142
7488992624,1cyclictest599-21systemd-logind00:00:012
7488992624,1cyclictest14699-21cron19:25:012
7488992623,2cyclictest303-21systemd-journal21:45:002
7485992626,0cyclictest0-21swapper/119:15:151
7485992624,1cyclictest31365-21cron20:00:001
7485992624,1cyclictest24078-21sendmail-msp00:20:011
7484992626,0cyclictest31660-21apt-get20:00:170
7484992626,0cyclictest0-21swapper/020:40:160
7484992624,2cyclictest626-21gdbus20:30:000
748999257,0cyclictest15063-21kworker/3:021:55:243
7489992525,0cyclictest0-21swapper/322:35:143
7488992525,0cyclictest25218-21apt-get20:55:132
7488992525,0cyclictest0-21swapper/220:00:162
7488992525,0cyclictest0-21swapper/219:35:152
7488992525,0cyclictest0-21swapper/219:10:122
7485992525,0cyclictest1557-21apt-get20:05:141
7485992525,0cyclictest0-21swapper/121:30:151
7484992525,0cyclictest0-21swapper/023:55:150
7484992525,0cyclictest0-21swapper/023:10:210
7484992525,0cyclictest0-21swapper/019:35:140
7484992524,1cyclictest22637-21munin-run20:50:000
7484992523,1cyclictest30763-21perf23:25:020
7489992424,0cyclictest16977-21apt-get22:55:143
7489992424,0cyclictest0-21swapper/322:40:143
7489992424,0cyclictest0-21swapper/322:10:143
7489992424,0cyclictest0-21swapper/321:50:153
7489992424,0cyclictest0-21swapper/321:50:153
7489992424,0cyclictest0-21swapper/321:40:133
7489992424,0cyclictest0-21swapper/319:40:143
7489992424,0cyclictest0-21swapper/300:00:143
7488992424,0cyclictest0-21swapper/220:10:162
7488992424,0cyclictest0-21swapper/219:30:172
7485992424,0cyclictest0-21swapper/123:00:151
7485992424,0cyclictest0-21swapper/120:55:131
7485992424,0cyclictest0-21swapper/120:50:141
7485992424,0cyclictest0-21swapper/120:40:161
7485992424,0cyclictest0-21swapper/120:25:121
7485992424,0cyclictest0-21swapper/120:15:161
7485992423,0cyclictest3890-21apt-get20:10:171
7484992424,0cyclictest0-21swapper/020:10:160
7484992423,1cyclictest28739-21apt-get00:30:030
7484992423,1cyclictest18749-21apt-get21:50:150
7484992423,1cyclictest18749-21apt-get21:50:150
7489992322,1cyclictest32533-21munin-run22:20:003
7489992320,2cyclictest26058-21awk23:15:013
7488992323,0cyclictest0-21swapper/220:30:142
7488992322,1cyclictest2402-21cron22:25:002
7488992321,1cyclictest17617-21munin-run20:40:012
7485992323,0cyclictest0-21swapper/123:15:151
7485992323,0cyclictest0-21swapper/121:55:141
7484992323,0cyclictest0-21swapper/021:15:130
7484992323,0cyclictest0-21swapper/019:45:150
7484992322,1cyclictest10635-21munin-run20:25:000
7489992220,1cyclictest7078-21apt-get22:35:003
7488992222,0cyclictest26350-21apt-get23:15:152
7488992222,0cyclictest0-21swapper/222:50:132
7485992222,0cyclictest0-21swapper/123:20:141
7485992222,0cyclictest0-21swapper/119:25:151
7484992222,0cyclictest0-21swapper/023:05:140
7484992219,2cyclictest303-21systemd-journal21:25:000
7489992121,0cyclictest0-21swapper/323:05:143
7489992121,0cyclictest0-21swapper/322:25:143
7489992121,0cyclictest0-21swapper/321:25:153
7489992120,1cyclictest0-21swapper/319:30:163
7488992121,0cyclictest18194-21apt-get20:40:162
7485992121,0cyclictest0-21swapper/121:50:151
7485992121,0cyclictest0-21swapper/121:50:151
7485992121,0cyclictest0-21swapper/121:40:131
7484992121,0cyclictest0-21swapper/022:00:150
7484992121,0cyclictest0-21swapper/019:15:150
7484992121,0cyclictest0-21swapper/019:10:130
7484992120,1cyclictest922-21apt-get23:30:130
7489992020,0cyclictest25527-21perf22:05:013
7488992020,0cyclictest0-21swapper/200:35:152
7488992019,1cyclictest0-21swapper/221:45:142
7485992018,1cyclictest31373-21perf00:35:001
7485992018,1cyclictest0-21swapper/119:50:001
7484992020,0cyclictest0-21swapper/022:40:150
7484992019,1cyclictest17315-21apt-get19:30:160
7489991919,0cyclictest0-21swapper/321:35:143
7489991919,0cyclictest0-21swapper/320:20:143
7488991919,0cyclictest0-21swapper/223:30:132
7488991919,0cyclictest0-21swapper/220:25:132
7488991917,1cyclictest303-21systemd-journal22:40:002
7488991917,1cyclictest29024-21cron19:55:002
7485991919,0cyclictest0-21swapper/122:40:141
7485991919,0cyclictest0-21swapper/120:00:161
7484991919,0cyclictest0-21swapper/022:45:160
7489991818,0cyclictest0-21swapper/320:15:163
7489991817,1cyclictest0-21swapper/319:50:153
7484991818,0cyclictest16423-21apt-get21:45:150
7484991816,1cyclictest0-21swapper/000:05:010
7489991717,0cyclictest0-21swapper/323:00:143
7489991717,0cyclictest0-21swapper/322:45:163
748999170,0cyclictest0-21swapper/323:24:583
7488991717,0cyclictest0-21swapper/222:00:162
7485991715,1cyclictest21741-21sendmail-msp19:40:011
7489991616,0cyclictest0-21swapper/321:20:133
7489991614,1cyclictest11191-21munin-run21:35:013
7489991614,1cyclictest0-21swapper/319:55:173
7488991616,0cyclictest0-21swapper/223:20:142
748899160,15cyclictest0-21swapper/222:35:012
7485991616,0cyclictest0-21swapper/121:15:131
7485991614,1cyclictest1996-21munin-run21:15:021
7485991614,1cyclictest0-21swapper/123:55:191
748599160,2cyclictest22762-21diskstats19:40:141
748599160,15cyclictest16182-21grep22:50:231
7484991616,0cyclictest0-21swapper/021:00:140
7484991614,1cyclictest16029-21ntp_states19:25:190
7484991614,1cyclictest0-21swapper/023:45:180
7484991614,1cyclictest0-21swapper/000:20:190
748999156,1cyclictest34-21ksoftirqd/321:20:013
7489991513,1cyclictest303-21systemd-journal23:50:003
748999150,1cyclictest20229-21perl00:10:183
748999150,14cyclictest27317-21sed21:00:003
748999150,0cyclictest0-21swapper/300:35:153
7488991515,0cyclictest0-21swapper/222:25:122
7488991515,0cyclictest0-21swapper/200:10:162
748899150,1cyclictest662-21latency_hist23:30:012
748899150,1cyclictest0-21swapper/223:35:162
748899150,1cyclictest0-21swapper/222:45:012
748899150,14cyclictest7934-21apt-get23:45:142
7485991515,0cyclictest0-21swapper/123:50:121
7485991515,0cyclictest0-21swapper/100:10:151
748599150,14cyclictest0-21swapper/119:32:491
7484991513,1cyclictest30954-21users19:55:220
748499150,1cyclictest17800-21diskstats00:05:150
748499150,1cyclictest0-21swapper/022:10:190
748499150,14cyclictest0-21swapper/022:35:170
7489991414,0cyclictest0-21swapper/323:25:143
7489991414,0cyclictest0-21swapper/320:40:263
748999140,14cyclictest0-21swapper/323:30:323
748999140,14cyclictest0-21swapper/322:50:483
748999140,14cyclictest0-21swapper/321:06:053
748999140,14cyclictest0-21swapper/321:00:293
748999140,14cyclictest0-21swapper/320:25:463
748999140,14cyclictest0-21swapper/320:10:113
748999140,14cyclictest0-21swapper/320:05:393
748999140,14cyclictest0-21swapper/320:00:443
748999140,14cyclictest0-21swapper/319:47:013
748999140,14cyclictest0-21swapper/319:35:223
748999140,14cyclictest0-21swapper/319:26:373
748999140,0cyclictest0-21swapper/323:52:463
748999140,0cyclictest0-21swapper/321:45:333
748999140,0cyclictest0-21swapper/320:49:063
748999140,0cyclictest0-21swapper/320:33:593
748999140,0cyclictest0-21swapper/319:16:123
748999140,0cyclictest0-21swapper/319:12:513
7488991413,1cyclictest15232sleep220:05:142
748899140,14cyclictest0-21swapper/223:40:032
748899140,14cyclictest0-21swapper/223:14:572
748899140,14cyclictest0-21swapper/223:00:422
748899140,14cyclictest0-21swapper/222:19:532
748899140,14cyclictest0-21swapper/222:11:542
748899140,14cyclictest0-21swapper/221:50:172
748899140,14cyclictest0-21swapper/221:50:172
748899140,14cyclictest0-21swapper/221:27:112
748899140,14cyclictest0-21swapper/221:21:002
748899140,14cyclictest0-21swapper/221:10:102
748899140,14cyclictest0-21swapper/221:00:012
748899140,14cyclictest0-21swapper/220:50:552
748899140,14cyclictest0-21swapper/219:55:482
748899140,14cyclictest0-21swapper/219:45:042
748899140,14cyclictest0-21swapper/219:41:432
748899140,0cyclictest0-21swapper/223:05:342
748899140,0cyclictest0-21swapper/222:55:192
748899140,0cyclictest0-21swapper/221:35:052
748899140,0cyclictest0-21swapper/221:30:542
748899140,0cyclictest0-21swapper/219:16:422
7485991414,0cyclictest0-21swapper/123:06:461
7485991414,0cyclictest0-21swapper/122:15:191
7485991414,0cyclictest0-21swapper/121:35:341
7485991414,0cyclictest0-21swapper/120:35:541
7485991414,0cyclictest0-21swapper/119:50:161
7485991414,0cyclictest0-21swapper/119:12:391
748599140,14cyclictest0-21swapper/123:45:151
748599140,14cyclictest0-21swapper/123:40:171
748599140,14cyclictest0-21swapper/123:11:111
748599140,14cyclictest0-21swapper/122:45:121
748599140,14cyclictest0-21swapper/122:38:141
748599140,14cyclictest0-21swapper/122:31:231
748599140,14cyclictest0-21swapper/122:25:021
748599140,14cyclictest0-21swapper/122:05:271
748599140,14cyclictest0-21swapper/121:05:591
748599140,14cyclictest0-21swapper/120:30:341
748599140,14cyclictest0-21swapper/120:21:261
748599140,14cyclictest0-21swapper/100:20:351
748599140,0cyclictest0-21swapper/122:20:411
748599140,0cyclictest0-21swapper/122:12:111
748599140,0cyclictest0-21swapper/121:25:151
748599140,0cyclictest0-21swapper/119:21:221
748599140,0cyclictest0-21swapper/100:35:201
748599140,0cyclictest0-21swapper/100:27:321
7484991414,0cyclictest0-21swapper/023:27:470
7484991414,0cyclictest0-21swapper/021:10:520
7484991414,0cyclictest0-21swapper/021:05:240
7484991414,0cyclictest0-21swapper/020:30:210
7484991414,0cyclictest0-21swapper/020:05:140
748499140,14cyclictest0-21swapper/023:37:240
748499140,14cyclictest0-21swapper/022:30:090
748499140,14cyclictest0-21swapper/022:25:360
748499140,14cyclictest0-21swapper/021:42:460
748499140,14cyclictest0-21swapper/021:35:160
748499140,14cyclictest0-21swapper/021:26:220
748499140,14cyclictest0-21swapper/020:50:000
748499140,14cyclictest0-21swapper/019:21:250
748499140,14cyclictest0-21swapper/000:36:130
748499140,14cyclictest0-21swapper/000:25:500
748499140,14cyclictest0-21swapper/000:10:180
748499140,0cyclictest0-21swapper/023:17:030
748499140,0cyclictest0-21swapper/022:07:000
748499140,0cyclictest0-21swapper/019:54:420
748499140,0cyclictest0-21swapper/019:40:090
7489991313,0cyclictest0-21swapper/323:15:373
7489991313,0cyclictest0-21swapper/320:50:203
7489991313,0cyclictest0-21swapper/300:15:193
7489991312,1cyclictest0-21swapper/323:40:153
7488991313,0cyclictest0-21swapper/223:51:222
7488991313,0cyclictest0-21swapper/222:45:372
7488991313,0cyclictest0-21swapper/200:20:132
7488991313,0cyclictest0-21swapper/200:00:522
7485991313,0cyclictest0-21swapper/123:35:161
7485991313,0cyclictest0-21swapper/123:26:511
7485991313,0cyclictest0-21swapper/100:07:321
7484991313,0cyclictest0-21swapper/022:51:320
7489991212,0cyclictest0-21swapper/323:35:203
7484991212,0cyclictest0-21swapper/023:50:190
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional