You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-20 - 21:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5.osadl.org (updated Thu Nov 20, 2025 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2228499310,30cyclictest31568-21cron07:30:011
2228799300,29cyclictest303-21systemd-journal12:25:012
2228499300,29cyclictest29638-21sendmail-msp12:00:011
2229199290,1cyclictest31941-21sh08:39:593
2228799290,1cyclictest0-21swapper/209:00:012
22284992928,1cyclictest6062-21apt-get10:00:121
22284992928,1cyclictest14166-21apt-get12:35:131
2228199290,28cyclictest6611-21apt-get11:10:110
2228199290,28cyclictest3982-21perf07:40:010
2228199290,1cyclictest0-21swapper/008:35:000
22291992828,0cyclictest22666-21apt-get10:35:133
2229199280,0cyclictest0-21swapper/308:50:133
2228799280,28cyclictest0-21swapper/212:25:102
2228799280,27cyclictest0-21swapper/210:25:122
2228799280,0cyclictest22539-21apt-get07:10:122
2228799280,0cyclictest11285-21apt-get11:20:142
2228799280,0cyclictest0-21swapper/211:00:132
22284992828,0cyclictest20602-21apt-get11:40:111
22284992827,1cyclictest20330-21apt-get10:30:131
22284992826,1cyclictest303-21systemd-journal08:30:001
2228499280,28cyclictest0-21swapper/108:05:121
2228499280,1cyclictest8948-21perf12:25:011
22281992828,0cyclictest0-21swapper/011:20:140
2228199280,28cyclictest0-21swapper/012:15:130
2228199280,27cyclictest0-21swapper/010:35:120
2228199280,0cyclictest3713-21apt-get09:55:130
2228199280,0cyclictest0-21swapper/008:20:150
22291992726,1cyclictest28806-21apt-get09:40:143
22287992727,0cyclictest0-21swapper/212:15:132
22287992727,0cyclictest0-21swapper/210:35:012
22287992726,1cyclictest1642-21cron11:00:002
22287992726,0cyclictest3136-21apt-get09:55:022
2228799270,0cyclictest0-21swapper/209:00:362
22284992727,0cyclictest28217-21apt-get09:40:021
22284992727,0cyclictest0-21swapper/108:40:091
22284992727,0cyclictest0-21swapper/107:50:121
22284992727,0cyclictest0-21swapper/107:10:131
2228499270,0cyclictest0-21swapper/109:30:121
2228499270,0cyclictest0-21swapper/107:40:121
22281992725,1cyclictest27064-21perf10:45:000
22291992626,0cyclictest0-21swapper/311:10:093
22291992626,0cyclictest0-21swapper/310:45:123
22291992624,1cyclictest303-21systemd-journal09:40:013
22287992626,0cyclictest0-21swapper/212:30:132
22287992626,0cyclictest0-21swapper/210:00:112
22287992626,0cyclictest0-21swapper/207:30:132
22287992624,1cyclictest1931-21apt-get08:45:002
22284992626,0cyclictest0-21swapper/109:35:091
22284992623,2cyclictest10422-21sh10:10:001
22281992626,0cyclictest0-21swapper/009:40:140
22287992525,0cyclictest0-21swapper/208:25:082
22284992525,0cyclictest0-21swapper/109:25:111
22284992525,0cyclictest0-21swapper/109:00:111
22284992523,1cyclictest20288-21cron11:40:001
22281992525,0cyclictest0-21swapper/008:55:130
22281992524,1cyclictest0-21swapper/011:55:010
22291992424,0cyclictest0-21swapper/310:20:113
22291992424,0cyclictest0-21swapper/309:10:123
22287992424,0cyclictest0-21swapper/208:30:102
22287992423,1cyclictest15628-21cron08:05:012
22284992424,0cyclictest0-21swapper/110:35:131
22281992424,0cyclictest8935-21apt-get11:15:120
22281992424,0cyclictest0-21swapper/012:25:010
22281992424,0cyclictest0-21swapper/011:30:150
22287992323,0cyclictest0-21swapper/211:15:122
22287992321,1cyclictest25003-21munin-run11:50:012
22287992321,1cyclictest24863-21apt-get07:15:152
22287992319,3cyclictest30406-21fschecks_count12:00:142
22284992323,0cyclictest1025-21apt-get09:50:111
22284992322,0cyclictest0-21swapper/108:35:151
22281992323,0cyclictest0-21swapper/008:10:120
22281992321,1cyclictest28242-21munin-run09:40:000
22287992222,0cyclictest0-21swapper/208:35:152
22287992222,0cyclictest0-21swapper/207:40:132
22284992222,0cyclictest211rcuc/108:05:011
22284992220,1cyclictest0-21swapper/110:49:591
22291992121,0cyclictest13588-21apt-get08:00:123
22291992121,0cyclictest0-21swapper/311:55:113
22291992119,1cyclictest3996-21cron11:05:013
22287992121,0cyclictest16246-21perf09:15:002
22284992121,0cyclictest0-21swapper/111:25:011
22284992121,0cyclictest0-21swapper/110:40:121
22284992121,0cyclictest0-21swapper/107:20:121
22281992121,0cyclictest0-21swapper/011:05:110
22281992120,1cyclictest2214-21apt-get12:10:130
22291992020,0cyclictest0-21swapper/308:55:133
22287992020,0cyclictest0-21swapper/209:50:132
22287992019,0cyclictest0-21swapper/212:10:132
22284992020,0cyclictest9240-21perf09:00:011
22284992020,0cyclictest0-21swapper/112:15:131
22284992020,0cyclictest0-21swapper/110:55:131
22281992020,0cyclictest0-21swapper/012:05:120
22281992020,0cyclictest0-21swapper/007:25:120
22291991919,0cyclictest31129-21apt-get09:45:153
22291991919,0cyclictest0-21swapper/311:35:123
22291991919,0cyclictest0-21swapper/310:40:133
22291991919,0cyclictest0-21swapper/309:55:123
22291991917,1cyclictest15670-21munin-run11:30:013
22287991919,0cyclictest0-21swapper/209:35:102
22287991919,0cyclictest0-21swapper/208:05:122
22287991919,0cyclictest0-21swapper/207:35:122
22284991919,0cyclictest0-21swapper/111:00:141
22284991919,0cyclictest0-21swapper/107:15:151
22281991919,0cyclictest0-21swapper/011:55:110
2229199182,15cyclictest29930-21apt-get12:00:113
22291991818,0cyclictest0-21swapper/309:25:103
22291991818,0cyclictest0-21swapper/307:55:103
2229199180,18cyclictest0-21swapper/311:48:093
22287991818,0cyclictest0-21swapper/211:40:122
22287991818,0cyclictest0-21swapper/209:30:122
22287991817,1cyclictest13611-21apt-get11:25:152
22284991818,0cyclictest0-21swapper/112:25:101
22284991818,0cyclictest0-21swapper/109:55:021
22284991817,0cyclictest18004-21apt-get10:25:121
22281991817,1cyclictest31945-21cron08:40:000
22291991717,0cyclictest0-21swapper/308:10:133
22287991717,0cyclictest0-21swapper/211:50:142
22287991717,0cyclictest0-21swapper/209:40:032
22287991716,0cyclictest11867-21apt-get09:05:092
22281991714,2cyclictest17475-21sed08:05:190
22291991616,0cyclictest0-21swapper/310:30:123
22291991616,0cyclictest0-21swapper/307:25:123
22291991614,1cyclictest11541-21cron12:30:013
22291991614,1cyclictest0-21swapper/309:35:003
22291991614,1cyclictest0-21swapper/309:20:143
22291991614,1cyclictest0-21swapper/307:15:193
2229199160,2cyclictest11842-21dpkg12:30:123
22287991616,0cyclictest16517-21apt-get09:15:102
22287991614,1cyclictest5013-21if_enp1s0.811:05:142
22287991614,1cyclictest16248-21munin-run12:40:012
22284991614,1cyclictest0-21swapper/112:00:181
22281991614,1cyclictest0-21swapper/010:05:150
2228199160,15cyclictest27835-21gltestperf07:20:140
2229199152,0cyclictest0-21swapper/309:00:113
22291991513,1cyclictest29248-21sh07:25:003
2229199150,1cyclictest13551-21fschecks_time10:15:143
2229199150,14cyclictest4007-21munin-run07:40:013
2229199150,14cyclictest22919-21apt-get08:20:153
22287991515,0cyclictest0-21swapper/209:45:162
2228799150,14cyclictest8385-21apt-get10:05:102
2228799150,14cyclictest0-21swapper/210:50:212
22284991515,0cyclictest31855-21apt-get07:30:131
22284991515,0cyclictest0-21swapper/112:30:121
22284991514,1cyclictest0-21swapper/109:16:581
22284991513,1cyclictest25687-21diskstats11:50:161
2228499150,1cyclictest4706-21/usr/sbin/munin11:05:121
2228499150,14cyclictest0-21swapper/111:25:161
2228499150,14cyclictest0-21swapper/111:10:491
2228499150,14cyclictest0-21swapper/109:10:141
2228499150,14cyclictest0-21swapper/109:05:101
22281991515,0cyclictest0-21swapper/010:20:120
22281991515,0cyclictest0-21swapper/009:15:120
22291991414,0cyclictest0-21swapper/308:26:483
22291991412,1cyclictest0-21swapper/308:05:153
2229199140,6cyclictest0-21swapper/308:45:113
2229199140,14cyclictest0-21swapper/312:38:203
2229199140,14cyclictest0-21swapper/312:05:033
2229199140,14cyclictest0-21swapper/311:42:513
2229199140,14cyclictest0-21swapper/311:31:553
2229199140,14cyclictest0-21swapper/311:05:093
2229199140,14cyclictest0-21swapper/310:50:343
2229199140,14cyclictest0-21swapper/310:29:453
2229199140,14cyclictest0-21swapper/310:12:233
2229199140,14cyclictest0-21swapper/310:05:073
2229199140,14cyclictest0-21swapper/310:01:233
2229199140,14cyclictest0-21swapper/309:51:013
2229199140,14cyclictest0-21swapper/309:15:043
2229199140,14cyclictest0-21swapper/309:05:343
2229199140,14cyclictest0-21swapper/308:40:153
2229199140,14cyclictest0-21swapper/308:30:243
2229199140,14cyclictest0-21swapper/307:51:353
2229199140,14cyclictest0-21swapper/307:44:383
2229199140,14cyclictest0-21swapper/307:11:563
2229199140,0cyclictest0-21swapper/311:51:173
22287991414,0cyclictest0-21swapper/207:55:292
2228799140,14cyclictest0-21swapper/211:31:592
2228799140,14cyclictest0-21swapper/210:38:442
2228799140,14cyclictest0-21swapper/210:20:282
2228799140,14cyclictest0-21swapper/210:12:042
2228799140,14cyclictest0-21swapper/209:23:542
2228799140,14cyclictest0-21swapper/208:52:092
2228799140,14cyclictest0-21swapper/208:15:072
2228799140,14cyclictest0-21swapper/207:46:262
2228799140,14cyclictest0-21swapper/207:26:362
2228799140,14cyclictest0-21swapper/207:20:022
2228799140,0cyclictest0-21swapper/211:12:392
2228799140,0cyclictest0-21swapper/209:27:402
2228799140,0cyclictest0-21swapper/208:23:022
2228799140,0cyclictest0-21swapper/207:50:132
22284991414,0cyclictest0-21swapper/110:10:081
22284991414,0cyclictest0-21swapper/108:45:471
22284991412,1cyclictest7395-21irqstats07:45:171
22284991412,1cyclictest0-21swapper/110:50:151
22284991412,1cyclictest0-21swapper/108:20:191
2228499140,14cyclictest0-21swapper/111:46:181
2228499140,14cyclictest0-21swapper/111:30:101
2228499140,14cyclictest0-21swapper/110:20:211
2228499140,14cyclictest0-21swapper/110:15:321
2228499140,14cyclictest0-21swapper/109:47:371
2228499140,14cyclictest0-21swapper/108:52:231
2228499140,14cyclictest0-21swapper/108:18:431
2228499140,14cyclictest0-21swapper/108:10:421
2228499140,14cyclictest0-21swapper/107:36:091
2228499140,0cyclictest0-21swapper/112:12:001
2228499140,0cyclictest0-21swapper/111:15:211
2228499140,0cyclictest0-21swapper/107:55:181
22281991414,0cyclictest0-21swapper/012:35:210
22281991414,0cyclictest0-21swapper/011:02:580
22281991414,0cyclictest0-21swapper/010:45:130
22281991414,0cyclictest0-21swapper/008:50:120
22281991414,0cyclictest0-21swapper/008:02:230
22281991414,0cyclictest0-21swapper/007:12:120
2228199140,5cyclictest0-21swapper/010:30:130
2228199140,14cyclictest0-21swapper/012:21:390
2228199140,14cyclictest0-21swapper/011:35:570
2228199140,14cyclictest0-21swapper/011:25:290
2228199140,14cyclictest0-21swapper/010:15:090
2228199140,14cyclictest0-21swapper/010:10:310
2228199140,14cyclictest0-21swapper/010:00:230
2228199140,14cyclictest0-21swapper/009:51:040
2228199140,14cyclictest0-21swapper/009:49:010
2228199140,14cyclictest0-21swapper/009:27:420
2228199140,14cyclictest0-21swapper/009:20:550
2228199140,14cyclictest0-21swapper/009:00:570
2228199140,14cyclictest0-21swapper/008:40:580
2228199140,14cyclictest0-21swapper/008:27:320
2228199140,14cyclictest0-21swapper/007:56:330
2228199140,14cyclictest0-21swapper/007:53:250
2228199140,0cyclictest0-21swapper/012:00:190
2228199140,0cyclictest0-21swapper/011:47:070
2228199140,0cyclictest0-21swapper/011:40:170
2228199140,0cyclictest0-21swapper/010:55:450
2228199140,0cyclictest0-21swapper/010:53:310
2228199140,0cyclictest0-21swapper/010:25:170
2228199140,0cyclictest0-21swapper/009:10:070
2228199140,0cyclictest0-21swapper/009:05:060
2228199140,0cyclictest0-21swapper/008:45:240
2228199140,0cyclictest0-21swapper/008:19:340
2228199140,0cyclictest0-21swapper/007:16:120
2229199139,4cyclictest0-21swapper/312:10:313
22291991313,0cyclictest0-21swapper/312:22:093
22291991313,0cyclictest0-21swapper/312:16:293
22291991313,0cyclictest0-21swapper/311:24:033
22291991313,0cyclictest0-21swapper/311:15:213
22291991313,0cyclictest0-21swapper/307:30:203
2229199130,0cyclictest0-21swapper/310:57:243
2229199130,0cyclictest0-21swapper/307:46:333
22287991313,0cyclictest0-21swapper/212:06:032
22287991313,0cyclictest0-21swapper/211:55:182
22287991313,0cyclictest0-21swapper/211:35:342
22287991313,0cyclictest0-21swapper/210:45:412
22287991313,0cyclictest0-21swapper/210:15:132
22287991313,0cyclictest0-21swapper/208:11:212
22287991311,1cyclictest26058-21ntp_states10:40:182
22284991313,0cyclictest0-21swapper/112:05:311
22284991313,0cyclictest0-21swapper/108:30:101
22281991313,0cyclictest0-21swapper/009:30:100
22281991313,0cyclictest0-21swapper/007:41:450
22281991311,1cyclictest8241-21users07:45:230
2228199130,0cyclictest0-21swapper/012:32:110
22287991212,0cyclictest0-21swapper/208:45:012
22281991212,0cyclictest0-21swapper/007:30:090
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional