You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-07 - 14:50
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Tue Jul 07, 2026 00:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
26813214210,17sleep10-21swapper/118:52:561
280399912757,12cyclictest18691-21systemd-run00:07:350
280399912757,12cyclictest18691-21systemd-run00:07:350
280399911952,11cyclictest0-21swapper/023:07:550
3018821110,6sleep230184-21ntp_states21:43:062
280459911134,31cyclictest0-21swapper/119:47:361
280459910932,40cyclictest9855-21sh22:57:561
280399910951,9cyclictest28204-21kworker/u17:1+flush-179:021:43:020
2778921046,77sleep00-21swapper/018:56:220
280459910374,17cyclictest3879-21sh22:47:541
280459910238,31cyclictest26904-21fschecks_time20:34:071
28045991012,84cyclictest20659-21apt-get21:27:461
2804599973,68cyclictest14820-21apt-get19:57:481
28048999673,13cyclictest23046-21latency_hist20:22:362
2804599962,72cyclictest22474-21ssh00:12:581
28039999675,15cyclictest10408-21ssh22:58:080
28045999454,34cyclictest28026-21cyclictest23:47:371
28045999353,34cyclictest0-21swapper/121:17:361
28045999327,34cyclictest0-21swapper/119:42:351
28039999271,14cyclictest13265-21ssh23:57:560
28039999271,14cyclictest13265-21ssh23:57:560
28045999045,40cyclictest0-21swapper/123:38:121
2804599902,54cyclictest176702sleep121:22:471
2804599902,54cyclictest176702sleep121:22:471
28039999059,21cyclictest21920-21latency20:17:580
2804599893,62cyclictest30047-21apt-get20:42:481
28048998866,15cyclictest17460-21sshd21:38:102
28045998755,22cyclictest20297-21needreboot00:09:421
2804599873,65cyclictest32762-21apt-get21:47:481
28045998735,45cyclictest10778-21cut23:53:081
28039998768,14cyclictest28026-21cyclictest23:57:320
28039998763,16cyclictest21403-21latency_hist20:17:360
28039998763,16cyclictest21403-21latency_hist20:17:360
28048998661,19cyclictest9960-21sh21:09:052
28048998661,19cyclictest9960-21sh21:09:052
28039998666,14cyclictest865-21latency_hist23:37:350
28039998642,29cyclictest181rcu_preempt00:17:510
28039998642,29cyclictest181rcu_preempt00:17:510
2803999863,50cyclictest19168-21apt-get00:07:580
28045998544,33cyclictest0-21swapper/122:38:081
28045998544,33cyclictest0-21swapper/122:38:081
28045998527,47cyclictest0-21swapper/121:18:251
277102859,51sleep227711-21sshd18:55:232
28048998449,25cyclictest25211-21grep23:23:072
28045998468,9cyclictest28026-21cyclictest22:17:371
28045998464,12cyclictest11213-21idleruntime-cro21:12:331
28045998464,12cyclictest11213-21idleruntime-cro21:12:331
28045998461,15cyclictest29113-21unixbench_multi20:38:101
28045998461,15cyclictest29113-21unixbench_multi20:38:101
28045998444,31cyclictest0-21swapper/123:28:081
2804599842,69cyclictest0-21swapper/122:02:441
28048998338,11cyclictest181rcu_preempt21:17:502
28039998361,15cyclictest8392-21latency_hist21:07:360
28048998232,14cyclictest181rcu_preempt20:52:592
28045998238,37cyclictest0-21swapper/119:02:581
2804599823,38cyclictest19646-21munin-plugin-st20:12:321
2804599823,38cyclictest19646-21munin-plugin-st20:12:321
2804599822,52cyclictest544-21cron20:02:531
28039998263,13cyclictest9151-21ntp_offset21:08:040
28039998263,13cyclictest9151-21ntp_offset21:08:040
28039998262,14cyclictest14617-21latency_hist19:57:370
28039998261,15cyclictest27977-21latency_hist20:37:350
28048998151,9cyclictest181rcu_preempt23:32:082
28048998146,9cyclictest181rcu_preempt20:07:502
28048998146,9cyclictest181rcu_preempt20:07:502
28045998163,11cyclictest28026-21cyclictest19:27:541
28045998156,17cyclictest27108-21cstates22:32:511
28039998157,17cyclictest5445-21sh21:02:370
28048998064,11cyclictest28026-21cyclictest21:57:352
28048998064,11cyclictest28026-21cyclictest21:57:352
28048998058,13cyclictest18282-21ssh23:12:352
28045998052,18cyclictest6160-21kworker/u17:1-flush-179:023:03:001
2804599803,66cyclictest0-21swapper/119:07:511
28045998028,44cyclictest5418-21sort21:02:371
28045998013,44cyclictest30663-21apt-get23:32:511
28039998062,11cyclictest12862-21cut23:02:560
28039998057,10cyclictest181rcu_preempt21:27:360
28039998057,10cyclictest181rcu_preempt21:27:360
28039998043,10cyclictest181rcu_preempt23:17:590
28048997939,9cyclictest24466-21munin-run20:27:332
28048997936,7cyclictest181rcu_preempt19:12:492
28045997963,10cyclictest16536-21ntp_offset00:03:031
28045997963,10cyclictest16536-21ntp_offset00:03:031
28045997938,34cyclictest28807-21sh00:24:081
28045997937,36cyclictest6778-21ntp_offset21:58:001
28045997937,33cyclictest0-21swapper/100:22:201
28045997937,33cyclictest0-21swapper/100:22:201
2804599793,64cyclictest0-21swapper/123:47:451
2804599793,64cyclictest0-21swapper/123:47:451
28039997957,12cyclictest0-21swapper/020:52:360
28039997957,12cyclictest0-21swapper/019:32:530
28039997951,10cyclictest181rcu_preempt19:27:510
28039997942,31cyclictest27158-21sh22:32:510
28039997941,15cyclictest19296-21mailstats23:13:090
28048997850,8cyclictest181rcu_preempt19:02:512
28048997849,7cyclictest181rcu_preempt21:57:432
28048997845,10cyclictest181rcu_preempt20:37:332
28048997839,12cyclictest0-21swapper/222:32:552
28048997833,8cyclictest181rcu_preempt00:12:362
28045997857,16cyclictest2965-21kworker/u17:0-events_unbound19:33:031
2804599783,63cyclictest12981-21apt-get19:52:441
2804599783,61cyclictest0-21swapper/120:12:471
2804599783,61cyclictest0-21swapper/120:12:471
2804599783,50cyclictest0-21swapper/122:42:571
28045997833,15cyclictest181rcu_preempt21:57:371
28045997833,15cyclictest181rcu_preempt21:57:371
28039997845,16cyclictest21711-21ssh22:23:060
28039997845,16cyclictest21711-21ssh22:23:060
28039997834,22cyclictest28201-21kworker/u17:1+xprtiod22:42:350
28039997834,22cyclictest28201-21kworker/u17:1+xprtiod22:42:350
28039997833,34cyclictest28026-21cyclictest21:48:070
2805499776,32cyclictest22475-21chrt00:12:583
28048997736,16cyclictest181rcu_preempt22:48:022
28045997752,16cyclictest20837-21sh22:22:361
28045997733,34cyclictest0-21swapper/119:48:071
28045997731,37cyclictest0-21swapper/123:17:551
28045997730,40cyclictest0-21swapper/121:42:331
28039997759,13cyclictest3735-21sh23:42:350
28039997742,28cyclictest17077-21cat20:03:250
28039997730,24cyclictest3521-21fschecks_time19:22:550
28039997730,24cyclictest3521-21fschecks_time19:22:550
2738527720,37sleep30-21swapper/318:53:163
28048997653,16cyclictest28026-21cyclictest00:22:352
28048997653,16cyclictest28026-21cyclictest00:22:352
28048997646,11cyclictest181rcu_preempt22:54:142
28048997646,11cyclictest181rcu_preempt22:54:142
28045997631,39cyclictest30216-21ssh21:43:071
2804599762,69cyclictest0-21swapper/122:07:451
2804599762,62cyclictest15612-21ssh23:07:481
28039997657,13cyclictest1113-21fschecks_time20:52:560
28039997651,10cyclictest181rcu_preempt22:43:220
28039997649,20cyclictest27594-21ssh23:27:500
28039997638,12cyclictest0-21swapper/019:02:570
28048997550,10cyclictest181rcu_preempt22:57:452
28048997513,54cyclictest87-21kswapd023:33:022
2804599753,61cyclictest0-21swapper/122:52:481
2804599753,61cyclictest0-21swapper/122:52:481
2804599752,60cyclictest24748-21apt-get20:27:441
2804599752,60cyclictest24748-21apt-get20:27:441
2803999756,59cyclictest14757-21apt-get21:17:570
28039997556,12cyclictest8106-21ssh22:54:110
28039997556,12cyclictest8106-21ssh22:54:110
28039997554,11cyclictest0-21swapper/020:44:380
28039997553,16cyclictest24625-21sshd21:33:100
28039997553,16cyclictest24625-21sshd21:33:100
28039997545,14cyclictest181rcu_preempt20:02:340
2803999752,42cyclictest6264-21ls21:57:470
28048997460,10cyclictest28026-21cyclictest20:57:592
28048997444,21cyclictest18194-21latency_hist20:07:362
2804599744,65cyclictest0-21swapper/120:22:451
2804599744,62cyclictest1900-21fschecks_time19:17:551
2804599743,59cyclictest0-21swapper/119:12:451
28045997432,35cyclictest0-21swapper/121:32:561
28045997432,35cyclictest0-21swapper/121:32:561
28039997457,11cyclictest22344-21ssh00:12:400
28039997447,21cyclictest3661-21/usr/sbin/munin22:47:540
28039997446,19cyclictest18843-21mailstats22:18:080
2805499739,37cyclictest0-21swapper/300:07:583
2805499733,32cyclictest31886-21chrt23:34:063
28048997343,9cyclictest181rcu_preempt19:32:482
28048997335,7cyclictest181rcu_preempt21:15:562
28048997314,25cyclictest8361-21fschecks_time19:37:552
28045997353,13cyclictest1063-21runrttasks20:52:551
28045997351,17cyclictest544-21cron20:52:331
2804599733,64cyclictest0-21swapper/120:17:471
28039997357,11cyclictest28026-21cyclictest22:12:060
28039997353,7cyclictest181rcu_preempt21:12:480
28039997351,14cyclictest28026-21cyclictest22:29:140
28039997346,20cyclictest27318-21latency_hist23:27:360
28039997339,18cyclictest181rcu_preempt19:44:070
28039997320,21cyclictest3488-21fschecks_time21:52:540
28039997320,21cyclictest3488-21fschecks_time21:52:540
28048997251,12cyclictest29595-21systemd-run20:42:342
28048997251,12cyclictest29595-21systemd-run20:42:342
28048997250,16cyclictest298-21in:imuxsock23:19:102
28048997246,20cyclictest26372-21apt-key20:32:372
28048997246,20cyclictest26372-21apt-key20:32:372
28048997246,19cyclictest1-21systemd00:00:222
28048997246,19cyclictest1-21systemd00:00:222
28048997236,14cyclictest32060-21kworker/u18:2-rpciod23:13:462
28048997236,10cyclictest181rcu_preempt22:12:502
28048997231,18cyclictest181rcu_preempt22:20:472
28039997234,8cyclictest181rcu_preempt21:28:300
28039997228,13cyclictest181rcu_preempt20:08:110
28039997228,13cyclictest181rcu_preempt20:08:110
28039997227,15cyclictest0-21swapper/000:24:240
28039997225,36cyclictest12888-21latency_hist19:52:380
28039997211,45cyclictest0-21swapper/022:03:440
2805499712,32cyclictest15608-21chrt23:07:483
2804899714,44cyclictest14934-21cpuspeed19:58:392
28048997141,21cyclictest18596-21apt-get00:07:372
28048997141,21cyclictest18596-21apt-get00:07:372
28048997140,9cyclictest23788-21ssh21:32:512
28048997140,9cyclictest23788-21ssh21:32:512
28048997140,9cyclictest181rcu_preempt20:12:502
28048997140,9cyclictest181rcu_preempt20:12:502
2804599713,63cyclictest0-21swapper/121:02:451
28045997129,36cyclictest0-21swapper/123:57:551
28045997129,36cyclictest0-21swapper/123:57:551
2804599712,55cyclictest22133-21ssh22:23:111
2804599712,55cyclictest22133-21ssh22:23:111
28045997121,25cyclictest0-21swapper/123:15:441
28039997133,24cyclictest181rcu_preempt23:47:130
28048997052,12cyclictest298-21in:imuxsock19:12:332
28048997049,11cyclictest0-21swapper/222:23:082
28048997049,11cyclictest0-21swapper/222:23:082
2804899704,43cyclictest733-21latency_hist20:52:362
28048997033,9cyclictest181rcu_preempt22:37:582
28048997033,9cyclictest181rcu_preempt22:37:582
28048997023,12cyclictest181rcu_preempt22:11:412
28048997021,14cyclictest181rcu_preempt23:39:342
2804599704,61cyclictest0-21swapper/119:22:491
2804599704,61cyclictest0-21swapper/119:22:491
28045997025,38cyclictest28586-21latency_hist19:02:361
28045997025,38cyclictest28586-21latency_hist19:02:361
2804599702,42cyclictest2186-21diskmemload22:27:381
28039997041,13cyclictest181rcu_preempt19:18:060
2805499693,25cyclictest14335-21chrt19:57:333
28048996949,15cyclictest5908-21kworker/u17:2-xprtiod23:53:462
28048996948,15cyclictest32741-21/usr/sbin/munin21:49:382
28048996941,8cyclictest181rcu_preempt23:06:502
2804899693,45cyclictest9970-21fschecks_time19:42:582
2804599693,55cyclictest24448-21/usr/sbin/munin23:23:051
28039996947,8cyclictest181rcu_preempt21:37:570
2803999694,39cyclictest6963-21ssh23:47:380
2803999694,39cyclictest6963-21ssh23:47:380
28039996943,19cyclictest26240-21apt-key20:32:350
28039996943,19cyclictest26240-21apt-key20:32:350
2805499683,23cyclictest14211-21chrt21:17:333
2805499683,21cyclictest14919-21chrt21:18:063
2804899683,50cyclictest6773-21cut23:47:352
2804899683,43cyclictest30029-21/usr/sbin/munin20:44:212
2804899682,48cyclictest39-21ksoftirqd/221:25:192
2804899682,48cyclictest39-21ksoftirqd/221:25:192
28048996816,38cyclictest14651-21apt-key19:57:372
28039996848,14cyclictest748-21cut19:13:070
2803999683,54cyclictest9036-21unixbench_multi19:38:090
2803999682,34cyclictest29841-21rm20:42:360
2803999682,34cyclictest29841-21rm20:42:360
2805499673,30cyclictest18428-21chrt00:07:063
2805499673,30cyclictest18428-21chrt00:07:063
2805499673,29cyclictest18438-21chrt20:07:523
2805499673,29cyclictest18438-21chrt20:07:523
2804899674,42cyclictest3737-21needreboot19:23:012
2804899674,42cyclictest3737-21needreboot19:23:012
2804899673,50cyclictest781-21ssh22:42:592
2804899673,10cyclictest5520-21ssh21:02:452
2803999672,49cyclictest25475-1kworker/0:0H+mmc_complete19:12:370
2805499663,26cyclictest7689-21chrt21:06:093
2805499663,23cyclictest32036-21chrt20:48:023
2805499663,23cyclictest306-21chrt21:47:463
2805499663,22cyclictest4644-21chrt23:43:063
2805499662,22cyclictest4845-21chrt22:48:223
28048996647,13cyclictest2432-21threads19:18:082
2804899662,42cyclictest6420-21latency_hist19:32:362
28048996621,8cyclictest7030-21ssh23:47:452
28048996621,8cyclictest7030-21ssh23:47:452
28039996643,9cyclictest181rcu_preempt22:12:520
2805499653,27cyclictest27552-21chrt20:34:213
2805499653,22cyclictest6293-21chrt19:32:343
2805499653,19cyclictest9062-21chrt22:02:363
2805499652,38cyclictest0-21swapper/319:57:483
2805499652,29cyclictest22839-21chrt22:25:103
2805499652,29cyclictest22839-21chrt22:25:103
2805499652,26cyclictest12978-21chrt23:57:463
2805499652,26cyclictest12978-21chrt23:57:463
2805499652,25cyclictest4738-21chrt21:01:193
2805499652,25cyclictest16404-21chrt22:13:433
2805499652,22cyclictest13641-21chrt22:09:173
2805499652,20cyclictest23176-21chrt23:19:483
28048996548,11cyclictest26651-21cron22:32:322
2804899653,45cyclictest21829-21apt-get00:12:482
2804899653,42cyclictest20878-21fschecks_count21:27:552
28039996538,9cyclictest181rcu_preempt19:01:110
28039996538,9cyclictest181rcu_preempt19:01:110
2805499644,23cyclictest25574-21chrt22:29:283
2805499643,27cyclictest27221-21chrt21:38:053
2805499643,23cyclictest5117-21taskset21:55:273
2805499643,23cyclictest5117-21taskset21:55:273
2805499643,21cyclictest28766-21chrt19:02:373
2805499643,21cyclictest28766-21chrt19:02:373
2805499643,20cyclictest21404-21chrt21:28:073
2805499642,30cyclictest2218-21taskset23:38:243
2805499642,25cyclictest14867-21chrt23:06:303
2805499642,23cyclictest1178-21chrt22:43:113
2805499642,21cyclictest9783-21chrt22:03:053
2805499633,24cyclictest26171-21taskset21:37:193
2805499633,24cyclictest26171-21taskset21:37:193
2805499633,21cyclictest17138-21taskset20:03:263
2805499633,20cyclictest27975-21taskset23:27:593
2805499632,23cyclictest10488-21chrt21:10:353
2805499632,23cyclictest10488-21chrt21:10:353
2805499632,22cyclictest9636-21chrt22:57:463
2805499632,21cyclictest31180-21chrt22:38:323
2805499632,21cyclictest31180-21chrt22:38:323
2805499632,21cyclictest25880-21chrt00:18:013
2805499632,21cyclictest25880-21chrt00:18:013
2804899633,33cyclictest352-21runrttasks00:26:152
28048996323,15cyclictest12706-21modprobe19:52:332
2805499623,23cyclictest7807-21chrt19:37:003
2805499623,21cyclictest26039-21chrt23:24:303
2805499623,21cyclictest12748-21chrt19:52:353
2805499623,21cyclictest1151-21chrt19:14:243
2805499623,19cyclictest9321-21chrt23:51:333
2805499623,19cyclictest9321-21chrt23:51:333
2805499623,19cyclictest30073-21chrt20:43:003
2805499622,24cyclictest29528-21chrt21:42:433
2805499622,24cyclictest20441-21chrt23:15:263
2805499622,22cyclictest3382-21chrt19:22:503
2805499622,22cyclictest3382-21chrt19:22:503
2805499622,22cyclictest24268-21chrt20:25:223
2805499622,20cyclictest29590-21taskset22:37:273
2805499622,19cyclictest31865-21chrt19:08:123
2805499613,22cyclictest18107-21chrt22:17:493
2805499613,20cyclictest25234-21chrt20:28:013
2805499613,20cyclictest25234-21chrt20:28:013
2805499612,24cyclictest1917-21chrt20:54:183
2805499612,23cyclictest21517-21chrt20:17:483
2805499612,23cyclictest18909-21chrt21:23:333
2805499612,23cyclictest18909-21chrt21:23:333
2805499612,22cyclictest10923-21chrt19:45:473
28048996141,10cyclictest0-21swapper/222:03:112
28039996140,8cyclictest181rcu_preempt20:22:550
2805499603,21cyclictest7865-21chrt22:53:293
2805499603,21cyclictest7865-21chrt22:53:293
2805499603,21cyclictest20223-21chrt20:12:583
2805499603,21cyclictest20223-21chrt20:12:583
2805499603,19cyclictest9189-21chrt19:39:073
2805499603,19cyclictest2834-21chrt19:20:233
2805499602,22cyclictest30506-21chrt19:06:093
2805499594,20cyclictest28594-21chrt00:23:323
2805499582,18cyclictest11535-21chrt23:54:253
2804899574,40cyclictest28705-21latency_hist19:02:362
2804899574,40cyclictest28705-21latency_hist19:02:362
2805499552,21cyclictest29278-21taskset20:39:153
2805499552,21cyclictest29278-21taskset20:39:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional