You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-21 - 23:56
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Thu May 21, 2026 12:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1944421549,24sleep00-21swapper/006:55:590
2068321116,15sleep20-21swapper/206:59:402
824821060,7sleep00-21swapper/008:00:450
209189910256,16cyclictest24339-21ssh10:41:370
209189910114,60cyclictest345-21lldpd11:11:100
20918999874,9cyclictest181rcu_preempt12:28:540
20918999874,9cyclictest181rcu_preempt12:28:540
2091899942,66cyclictest8069-21runrttasks12:01:090
2093699936,51cyclictest0-21swapper/311:31:373
20931999313,54cyclictest9918-21apt-get11:11:002
2080629215,53sleep1277-21dbus-daemon07:00:451
20931999142,25cyclictest20909-21cyclictest12:01:452
2093199907,60cyclictest9295-21kworker/u19:0+rpciod10:41:512
20931999052,11cyclictest181rcu_preempt12:27:282
20931999052,11cyclictest181rcu_preempt12:27:282
20931999039,8cyclictest181rcu_preempt08:15:442
20931999039,8cyclictest181rcu_preempt08:15:442
20931998941,13cyclictest181rcu_preempt10:00:452
20924998823,24cyclictest26101-21seq10:43:551
20924998819,28cyclictest8152-21ssh12:01:241
20918998868,14cyclictest29958-21kernelversion07:26:060
20918998828,26cyclictest181rcu_preempt11:48:250
20931998757,10cyclictest181rcu_preempt07:26:132
20931998755,10cyclictest181rcu_preempt10:06:082
20931998751,9cyclictest181rcu_preempt12:05:482
20918998764,9cyclictest181rcu_preempt07:51:170
20918998753,12cyclictest181rcu_preempt10:30:580
20918998739,12cyclictest181rcu_preempt09:29:540
20931998635,18cyclictest181rcu_preempt11:30:442
20931998632,12cyclictest181rcu_preempt10:01:092
20931998612,52cyclictest26237-21apt-get09:51:052
20931998612,52cyclictest26237-21apt-get09:51:052
20924998630,21cyclictest27830-21diskmemload11:51:001
20924998626,24cyclictest29838-21seq09:02:581
20918998662,9cyclictest181rcu_preempt09:18:300
20918998662,9cyclictest181rcu_preempt09:18:300
20918998662,8cyclictest181rcu_preempt07:01:040
20918998642,11cyclictest181rcu_preempt09:23:160
20918998640,18cyclictest29068-21sh10:48:490
20931998556,9cyclictest30801-21ssh11:45:372
20918998566,12cyclictest18459-21ssh11:25:230
20918998552,12cyclictest181rcu_preempt10:58:220
20931998451,9cyclictest181rcu_preempt11:37:452
20931998451,9cyclictest181rcu_preempt11:37:452
2093199843,55cyclictest13962-21apt-get09:31:002
20931998432,16cyclictest181rcu_preempt12:16:042
20924998421,30cyclictest8217-21rm11:07:381
20918998463,15cyclictest27808-21latency_hist07:20:450
20918998463,15cyclictest27808-21latency_hist07:20:450
20918998456,11cyclictest181rcu_preempt09:01:110
20918998449,13cyclictest181rcu_preempt12:07:100
20918998411,61cyclictest14379-21ssh09:31:380
20931998362,9cyclictest0-21swapper/209:06:202
20931998335,11cyclictest181rcu_preempt07:56:052
20918998357,16cyclictest2220-21fschecks_time07:41:050
20918998354,15cyclictest181rcu_preempt08:30:450
20918998348,12cyclictest181rcu_preempt12:16:160
20931998260,12cyclictest0-21swapper/212:11:052
20931998260,12cyclictest0-21swapper/212:11:052
20931998241,8cyclictest181rcu_preempt08:40:592
20931998235,12cyclictest181rcu_preempt10:26:032
20931998235,12cyclictest181rcu_preempt10:26:032
20931998234,14cyclictest181rcu_preempt08:01:072
20931998234,14cyclictest181rcu_preempt08:01:072
20931998232,29cyclictest0-21swapper/211:05:222
20931998232,29cyclictest0-21swapper/211:05:222
20924998224,24cyclictest26189-21seq09:50:501
20924998224,24cyclictest26189-21seq09:50:501
20924998222,25cyclictest14000-21sh12:10:561
20924998222,25cyclictest14000-21sh12:10:561
20924998220,24cyclictest23940-21ssh11:33:111
20924998216,28cyclictest352-21runrttasks12:21:571
20924998216,28cyclictest0-21swapper/110:08:401
20918998250,11cyclictest181rcu_preempt10:16:040
20918998250,11cyclictest181rcu_preempt10:16:040
20918998248,13cyclictest181rcu_preempt08:15:460
20918998248,13cyclictest181rcu_preempt08:15:460
20918998243,12cyclictest181rcu_preempt07:10:590
20918998243,12cyclictest181rcu_preempt07:10:590
20918998237,19cyclictest58-21kcompactd010:14:050
20931998141,8cyclictest181rcu_preempt09:46:192
20924998117,26cyclictest24367-21seq07:09:211
20924998117,26cyclictest24367-21seq07:09:211
20924998116,25cyclictest27830-21diskmemload11:12:571
20924998114,29cyclictest19856-21ls11:26:201
20924998112,29cyclictest0-21swapper/110:52:251
20918998150,10cyclictest181rcu_preempt11:56:010
20918998147,14cyclictest181rcu_preempt11:06:150
20918998140,16cyclictest11060-21switchtime08:06:480
2039228111,41sleep30-21swapper/306:57:083
20936998014,29cyclictest0-21swapper/312:01:333
20931998035,8cyclictest181rcu_preempt08:06:462
20931998031,13cyclictest181rcu_preempt10:21:212
20924998062,11cyclictest22690-21munin-node10:11:071
20924998062,11cyclictest17717-21ssh10:30:461
20924998062,11cyclictest17717-21ssh10:30:461
20924998058,15cyclictest15908-21threads08:21:171
20924998053,21cyclictest544-21cron07:55:431
20924998021,20cyclictest21957-21seq10:36:211
20924998019,25cyclictest17110-21ssh09:36:111
20924998017,28cyclictest1748-21seq10:03:471
20924998014,40cyclictest4971-21sendmail07:50:441
20924998014,40cyclictest4971-21sendmail07:50:441
20918998056,9cyclictest181rcu_preempt11:41:090
20918998056,9cyclictest181rcu_preempt09:54:260
20918998056,9cyclictest181rcu_preempt09:54:260
20918998048,23cyclictest24673-21latency_hist07:10:470
20918998048,23cyclictest24673-21latency_hist07:10:470
20918998046,9cyclictest181rcu_preempt07:25:460
20918998039,28cyclictest0-21swapper/010:26:000
20918998039,28cyclictest0-21swapper/010:26:000
2093699794,30cyclictest21634-21chrt11:30:433
20931997949,8cyclictest181rcu_preempt07:06:142
20931997949,8cyclictest181rcu_preempt07:06:142
20931997945,9cyclictest4714-21/usr/sbin/munin11:56:172
2093199794,39cyclictest13234-21fschecks_time11:16:062
2093199794,39cyclictest13234-21fschecks_time11:16:062
20931997939,11cyclictest181rcu_preempt10:35:002
20931997939,10cyclictest181rcu_preempt12:25:462
20931997934,8cyclictest181rcu_preempt09:25:432
20931997924,32cyclictest0-21swapper/210:46:102
20924997918,25cyclictest2318-21seq10:57:531
20924997916,27cyclictest352-21runrttasks12:10:351
2091899796,60cyclictest27830-21diskmemload11:31:040
20918997954,17cyclictest2728-21unixbench_multi09:11:200
20918997943,11cyclictest181rcu_preempt07:34:430
20918997941,12cyclictest181rcu_preempt11:01:050
20918997941,12cyclictest181rcu_preempt11:01:050
20918997938,17cyclictest181rcu_preempt08:51:050
20918997914,26cyclictest15-21ksoftirqd/009:50:460
20936997813,42cyclictest0-21swapper/309:51:033
20936997813,42cyclictest0-21swapper/309:51:033
20931997841,10cyclictest181rcu_preempt08:16:182
20931997841,10cyclictest181rcu_preempt08:16:182
20931997838,11cyclictest181rcu_preempt08:25:462
20924997859,13cyclictest2374-21systemd-journal12:17:481
20924997818,27cyclictest9076-21sh09:22:021
20918997859,10cyclictest0-21swapper/008:31:150
20918997852,9cyclictest181rcu_preempt11:18:340
20918997852,9cyclictest181rcu_preempt11:18:340
2093699773,36cyclictest3187-21chrt10:06:093
2093699772,33cyclictest4760-21chrt09:15:583
2093699772,33cyclictest4760-21chrt09:15:583
2093699772,27cyclictest27379-21chrt07:16:213
2093699772,27cyclictest27379-21chrt07:16:213
20931997759,8cyclictest0-21swapper/211:32:022
20931997744,9cyclictest181rcu_preempt07:15:542
20931997744,9cyclictest181rcu_preempt07:15:542
20931997743,11cyclictest181rcu_preempt10:58:342
20931997736,9cyclictest181rcu_preempt07:15:452
20931997736,9cyclictest181rcu_preempt07:15:452
20931997734,12cyclictest181rcu_preempt07:40:462
20924997720,24cyclictest14213-21sh09:31:341
20924997720,20cyclictest5951-21seq09:16:401
20924997720,20cyclictest5951-21seq09:16:401
20924997717,29cyclictest16896-21unixbench_multi11:21:171
20924997716,22cyclictest0-21swapper/108:16:331
20924997716,22cyclictest0-21swapper/108:16:331
20918997761,9cyclictest0-21swapper/012:11:070
20918997761,9cyclictest0-21swapper/012:11:070
20918997757,15cyclictest20909-21cyclictest11:28:160
20918997753,10cyclictest181rcu_preempt12:20:590
20918997740,14cyclictest181rcu_preempt10:52:500
20931997647,8cyclictest181rcu_preempt07:47:112
20931997647,8cyclictest181rcu_preempt07:47:112
20931997644,13cyclictest181rcu_preempt09:17:182
20931997644,13cyclictest181rcu_preempt09:17:182
20931997642,7cyclictest181rcu_preempt10:11:062
20931997637,9cyclictest181rcu_preempt08:36:112
20931997636,8cyclictest181rcu_preempt10:35:462
20931997635,18cyclictest181rcu_preempt09:40:122
20931997633,8cyclictest181rcu_preempt09:02:352
20924997620,26cyclictest6806-21seq11:59:001
20924997619,20cyclictest13396-21seq10:22:391
20924997616,23cyclictest732-21seq11:48:551
20924997613,29cyclictest0-21swapper/107:16:091
20924997613,29cyclictest0-21swapper/107:16:091
20918997653,15cyclictest31151-21ssh09:58:360
20918997652,13cyclictest0-21swapper/007:40:470
20918997642,7cyclictest0-21swapper/010:21:110
20918997641,11cyclictest181rcu_preempt09:40:120
2093699753,35cyclictest12001-21chrt09:26:493
20931997538,10cyclictest181rcu_preempt10:51:162
20931997537,9cyclictest181rcu_preempt08:31:102
20931997537,7cyclictest181rcu_preempt07:00:492
20931997533,16cyclictest181rcu_preempt08:30:462
20931997532,9cyclictest181rcu_preempt09:30:022
20931997532,8cyclictest181rcu_preempt11:06:002
20931997531,7cyclictest181rcu_preempt11:49:152
20924997521,30cyclictest29262-21runrttasks09:55:571
20924997521,22cyclictest24389-21taskset12:27:121
20924997521,22cyclictest24389-21taskset12:27:121
20931997451,8cyclictest181rcu_preempt09:42:012
20931997444,11cyclictest181rcu_preempt11:55:402
20931997442,9cyclictest181rcu_preempt09:11:162
20931997436,8cyclictest181rcu_preempt07:31:102
20924997423,21cyclictest22232-21seq07:03:101
20924997412,25cyclictest0-21swapper/108:46:051
20924997412,25cyclictest0-21swapper/108:46:051
20918997453,8cyclictest181rcu_preempt08:59:280
20918997453,10cyclictest0-21swapper/008:21:040
20918997446,11cyclictest181rcu_preempt11:50:590
20918997444,7cyclictest181rcu_preempt10:06:060
20918997443,10cyclictest181rcu_preempt08:45:570
20918997443,10cyclictest181rcu_preempt08:45:570
2093699734,34cyclictest0-21swapper/310:41:063
20931997351,8cyclictest181rcu_preempt10:19:382
20931997351,8cyclictest181rcu_preempt10:19:382
20931997338,8cyclictest181rcu_preempt08:51:042
20931997335,8cyclictest181rcu_preempt11:21:052
20931997330,8cyclictest181rcu_preempt07:21:112
20924997355,9cyclictest0-21swapper/108:11:191
20924997355,9cyclictest0-21swapper/108:11:191
20924997318,24cyclictest26077-21seq07:15:211
20924997318,24cyclictest26077-21seq07:15:211
20924997315,28cyclictest352-21runrttasks09:48:551
20924997310,40cyclictest0-21swapper/107:41:161
20918997344,9cyclictest181rcu_preempt07:46:120
20918997344,9cyclictest181rcu_preempt07:46:120
20918997331,13cyclictest181rcu_preempt10:04:490
20931997233,9cyclictest181rcu_preempt08:46:052
20931997233,9cyclictest181rcu_preempt08:46:052
20931997229,9cyclictest181rcu_preempt07:51:072
20931997210,12cyclictest381ktimers/207:42:052
2092499724,37cyclictest18606-21fschecks_count08:31:041
20924997218,25cyclictest15299-21taskset11:19:561
20924997218,25cyclictest15299-21taskset11:19:561
20924997214,18cyclictest352-21runrttasks11:04:251
20924997214,18cyclictest352-21runrttasks11:04:251
20918997247,11cyclictest181rcu_preempt08:01:290
20918997247,11cyclictest181rcu_preempt08:01:290
20918997244,20cyclictest15008-21latency_hist08:20:450
20918997244,20cyclictest15008-21latency_hist08:20:450
20918997243,11cyclictest181rcu_preempt09:43:590
20918997237,7cyclictest181rcu_preempt11:39:570
20918997237,7cyclictest181rcu_preempt11:39:570
20918997233,8cyclictest181rcu_preempt08:36:090
20918997232,20cyclictest20909-21cyclictest09:10:000
2093699713,31cyclictest17398-21taskset09:36:183
2093699712,31cyclictest22838-21chrt10:38:473
20924997142,19cyclictest27343-21cut10:46:051
2092499713,42cyclictest22348-21grep08:41:171
20924997119,23cyclictest17845-21seq08:27:301
20924997119,22cyclictest26132-21taskset08:54:501
20924997119,21cyclictest29239-21seq07:24:401
20924997118,23cyclictest358-21/usr/sbin/munin07:36:171
20924997116,26cyclictest27984-21latency_hist09:00:461
20924997115,22cyclictest0-21swapper/110:20:311
20924997115,22cyclictest0-21swapper/110:20:311
20924997113,24cyclictest0-21swapper/108:01:071
20924997113,24cyclictest0-21swapper/108:01:071
20918997147,8cyclictest181rcu_preempt08:41:180
20931997033,7cyclictest181rcu_preempt08:56:182
2092499704,23cyclictest1704-21/usr/sbin/munin09:11:111
20924997034,26cyclictest8178-21modprobe08:00:431
20924997019,21cyclictest19130-21seq10:31:511
20924997015,23cyclictest20518-21ssh09:41:131
20924997012,23cyclictest31779-21ntp_states09:06:151
20918997041,11cyclictest181rcu_preempt10:36:140
2092499694,45cyclictest31007-21ssh11:45:451
20924996915,24cyclictest30658-21seq07:27:111
20924996914,25cyclictest0-21swapper/111:40:081
20924996914,25cyclictest0-21swapper/111:40:081
20924996850,11cyclictest13634-21cp09:30:461
2092499683,52cyclictest32616-21grep07:35:451
2092499683,48cyclictest21360-21apt08:40:431
20924996713,27cyclictest0-21swapper/108:06:121
20936996511,19cyclictest0-21swapper/309:06:213
2093699637,20cyclictest0-21swapper/308:06:253
2093699625,32cyclictest917-21kworker/3:1+events07:11:123
2093699625,32cyclictest917-21kworker/3:1+events07:11:123
20936996213,18cyclictest0-21swapper/311:04:263
20936996213,18cyclictest0-21swapper/311:04:263
20936996113,13cyclictest0-21swapper/308:36:123
20936996014,35cyclictest0-21swapper/309:31:073
2093699593,40cyclictest3152-21taskset11:52:113
2093699593,39cyclictest22659-21chrt09:45:423
2093699593,37cyclictest917-21kworker/3:1+events10:21:053
2093699574,37cyclictest17706-21taskset08:26:203
2093699574,35cyclictest1725-21chrt07:40:433
2093699573,38cyclictest18959-21taskset12:18:493
2093699563,37cyclictest29792-21chrt10:50:433
2093699563,36cyclictest23423-21chrt07:06:083
2093699563,36cyclictest23423-21chrt07:06:083
2093699563,35cyclictest8659-21taskset08:01:043
2093699563,35cyclictest8659-21taskset08:01:043
2093699562,38cyclictest6850-21taskset11:59:083
2093699562,36cyclictest5366-21taskset07:51:003
2093699553,38cyclictest9189-21taskset10:16:063
2093699553,38cyclictest9189-21taskset10:16:063
2093699552,38cyclictest3855-21chrt07:46:063
2093699552,38cyclictest3855-21chrt07:46:063
2093699552,37cyclictest13509-21taskset11:16:123
2093699552,37cyclictest13509-21taskset11:16:123
20936995513,26cyclictest0-21swapper/311:10:583
2093699544,32cyclictest16015-21taskset11:20:583
2093699543,37cyclictest9001-21chrt11:09:473
2093699543,37cyclictest8205-21chrt09:21:093
2093699542,38cyclictest21684-21taskset07:01:143
2093699542,35cyclictest2785-21chrt09:11:203
2093699542,35cyclictest14489-21taskset08:16:193
2093699542,35cyclictest14489-21taskset08:16:193
2093699533,36cyclictest31241-21chrt11:45:593
2093699533,36cyclictest15961-21chrt08:21:183
2093699533,35cyclictest30035-21chrt10:50:473
2093699533,35cyclictest2937-21taskset07:41:203
2093699533,35cyclictest16108-21chrt12:14:113
2093699533,35cyclictest16108-21chrt12:14:113
2093699533,34cyclictest7719-21chrt10:13:353
2093699532,37cyclictest25423-21taskset11:36:063
2093699532,37cyclictest25423-21taskset11:36:063
2093699532,37cyclictest1199-21chrt10:56:103
2093699532,36cyclictest29623-21taskset09:56:083
2093699523,34cyclictest30565-21chrt07:26:173
2093699522,37cyclictest26657-21taskset08:56:043
2093699522,33cyclictest14830-21chrt10:25:543
2093699522,33cyclictest14830-21chrt10:25:543
2093699513,34cyclictest29375-21taskset11:41:373
2093699513,34cyclictest11575-21chrt12:06:133
2093699513,33cyclictest19388-21chrt10:32:353
2093699513,31cyclictest21611-21chrt08:40:543
2093699512,36cyclictest22984-21chrt09:45:543
2093699503,36cyclictest12708-21taskset08:11:173
2093699503,36cyclictest12708-21taskset08:11:173
2093699503,33cyclictest28152-21chrt09:00:543
2093699503,33cyclictest1283-21chrt10:02:283
2093699503,30cyclictest18402-21chrt08:30:533
2093699502,36cyclictest21402-21taskset12:22:143
2093699493,34cyclictest7650-21chrt07:56:193
2093699493,31cyclictest23082-21chrt12:25:583
2093699493,31cyclictest23082-21chrt12:25:583
2093699493,28cyclictest25176-21chrt08:51:063
2093699492,36cyclictest28006-21chrt07:20:593
2093699482,35cyclictest23959-21chrt08:46:163
2093699482,35cyclictest23959-21chrt08:46:163
2093699482,34cyclictest31252-21chrt07:30:593
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional