You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-06 - 11:15
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Thu Aug 06, 2026 00:44:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
67999913745,83cyclictest0-21swapper/021:16:060
6799991326,54cyclictest32631-21kworker/u19:2+ext4-rsv-conversion23:45:570
656321197,16sleep00-21swapper/018:54:280
67999911199,7cyclictest0-21swapper/021:56:440
68179910912,81cyclictest30066-21chrt22:15:483
68179910912,81cyclictest30066-21chrt22:15:483
6799991099,67cyclictest3981-21apt-get23:20:500
68129910276,18cyclictest21087-21latency_hist22:55:322
68129910173,19cyclictest31536-21apt-key20:10:332
68129910173,19cyclictest31536-21apt-key20:10:332
68129910081,12cyclictest18527-40ogrotate23:45:322
6799999882,9cyclictest0-21swapper/000:11:010
6799999882,9cyclictest0-21swapper/000:11:010
681799962,83cyclictest3992-21chrt23:20:443
6799999668,12cyclictest181rcu_preempt21:15:340
6799999359,13cyclictest181rcu_preempt19:55:460
6799999256,11cyclictest181rcu_preempt19:25:470
6799999256,11cyclictest181rcu_preempt19:25:470
679999914,66cyclictest30040-21kworker/u17:1+ext4-rsv-conversion22:15:510
679999914,66cyclictest30040-21kworker/u17:1+ext4-rsv-conversion22:15:510
6799999055,14cyclictest181rcu_preempt20:50:450
6799998952,27cyclictest11138-21ssh22:37:480
6805998850,25cyclictest8255-21kworker/u19:1-ext4-rsv-conversion23:20:441
6812998713,41cyclictest39-21ksoftirqd/219:43:002
6805998766,14cyclictest1-21systemd00:25:311
54182877,50sleep15469-21df18:50:501
6812998649,12cyclictest181rcu_preempt22:10:342
6812998613,33cyclictest39-21ksoftirqd/220:11:462
6812998613,33cyclictest39-21ksoftirqd/220:11:462
6805998662,18cyclictest21226-21sh22:00:551
6799998668,11cyclictest15-21ksoftirqd/023:00:340
6799998668,11cyclictest15-21ksoftirqd/023:00:340
681799855,53cyclictest0-21swapper/321:56:013
681299854,38cyclictest39-21ksoftirqd/222:58:442
681299854,38cyclictest39-21ksoftirqd/222:58:442
6812998516,29cyclictest39-21ksoftirqd/221:02:052
6812998512,41cyclictest39-21ksoftirqd/219:24:462
6812998512,41cyclictest39-21ksoftirqd/219:24:462
6805998567,11cyclictest6786-21cyclictest20:46:051
6805998467,11cyclictest3451-21gpgv23:20:321
6799998446,26cyclictest15368-21latency_hist19:20:340
6812998360,8cyclictest181rcu_preempt22:20:552
6799998364,13cyclictest2258-21systemd-run21:30:310
6812998241,28cyclictest6808-21cat23:25:372
6812998210,44cyclictest39-21ksoftirqd/223:37:442
6812998210,43cyclictest39-21ksoftirqd/220:21:582
6799998251,19cyclictest16999-21latency_hist19:25:340
6799998251,19cyclictest16999-21latency_hist19:25:340
6799998246,13cyclictest181rcu_preempt23:14:430
6812998113,39cyclictest39-21ksoftirqd/219:00:032
6805998163,12cyclictest1-21systemd22:51:551
6805998157,18cyclictest7206-21fschecks_time18:55:531
6799998155,18cyclictest17580-21apt-key21:55:340
6799998154,18cyclictest19802-21latency_hist21:05:330
6799998138,13cyclictest15-21ksoftirqd/000:22:310
681299802,45cyclictest39-21ksoftirqd/222:04:162
6812998012,27cyclictest39-21ksoftirqd/220:40:592
681299793,36cyclictest39-21ksoftirqd/221:19:432
6812997852,20cyclictest4239-21latency_hist00:15:332
6812997852,20cyclictest4239-21latency_hist00:15:332
6812997817,23cyclictest39-21ksoftirqd/222:17:082
6812997817,23cyclictest39-21ksoftirqd/222:17:082
6799997837,32cyclictest15529-21modprobe23:40:290
6799997813,10cyclictest181rcu_preempt21:43:530
681799773,58cyclictest0-21swapper/323:45:553
6812997739,23cyclictest352-21runrttasks23:50:262
681299772,35cyclictest39-21ksoftirqd/221:37:172
681299772,32cyclictest39-21ksoftirqd/200:22:512
6805997756,15cyclictest6786-21cyclictest20:10:341
6805997756,15cyclictest6786-21cyclictest20:10:341
6799997761,10cyclictest15-21ksoftirqd/021:39:080
6799997756,15cyclictest300-21rs:main0
6799997754,8cyclictest181rcu_preempt22:51:550
6799997742,28cyclictest0-21swapper/023:16:000
6799997731,12cyclictest181rcu_preempt21:46:040
6812997658,12cyclictest9649-21sh23:30:312
6812997656,7cyclictest181rcu_preempt21:48:372
6812997638,22cyclictest27183-21if_err_eth022:10:522
6812997638,22cyclictest27183-21if_err_eth022:10:522
681299762,35cyclictest21785-21latency_hist19:40:332
6805997660,10cyclictest9938-21rm22:35:561
6805997660,10cyclictest6786-21cyclictest21:35:331
6805997660,10cyclictest6786-21cyclictest21:35:331
6805997658,13cyclictest6786-21cyclictest23:01:541
6799997637,13cyclictest12321-21kworker/u17:2+xprtiod20:56:060
615727610,40sleep26248-21grep18:51:162
681799753,32cyclictest15422-21chrt22:45:433
6812997556,13cyclictest1236-21latency_hist00:10:322
6812997554,8cyclictest181rcu_preempt22:32:152
6812997547,12cyclictest181rcu_preempt00:18:032
6812997536,13cyclictest181rcu_preempt19:51:382
6812997520,45cyclictest381ktimers/221:50:582
6812997510,25cyclictest39-21ksoftirqd/221:40:412
6799997559,11cyclictest15-21ksoftirqd/023:50:510
6799997545,22cyclictest964-21kernelversion22:20:560
6799997545,20cyclictest18823-21apt-key23:45:350
6799997538,16cyclictest181rcu_preempt19:34:230
679999753,35cyclictest15851-21latency22:45:560
679999752,20cyclictest1-21systemd22:10:310
681799744,30cyclictest30468-21chrt20:05:563
681799744,30cyclictest30468-21chrt20:05:563
681799742,31cyclictest4101-21taskset20:25:323
6812997440,14cyclictest181rcu_preempt23:15:482
6812997434,14cyclictest39-21ksoftirqd/223:14:432
6812997433,12cyclictest15987-21kworker/u17:1-xprtiod21:57:372
6812997426,25cyclictest13690-21diskmemload20:55:522
680599747,55cyclictest30025-21apt-get22:15:461
680599747,55cyclictest30025-21apt-get22:15:461
6805997451,17cyclictest2374-21systemd-journal21:50:301
6805997413,51cyclictest19082-21apt-get23:45:491
6799997445,12cyclictest181rcu_preempt20:45:420
681799733,27cyclictest18482-21chrt19:30:323
681799733,27cyclictest18482-21chrt19:30:323
6812997355,12cyclictest9904-21/usr/sbin/munin23:30:482
6812997313,29cyclictest39-21ksoftirqd/219:14:132
681299731,27cyclictest39-21ksoftirqd/222:47:302
6812997312,39cyclictest39-21ksoftirqd/222:42:162
6812997312,39cyclictest39-21ksoftirqd/222:42:162
6812997311,35cyclictest39-21ksoftirqd/222:39:572
6812997311,27cyclictest39-21ksoftirqd/219:17:212
6805997350,17cyclictest23659-21open_files21:11:041
6805997326,9cyclictest301ktimers/121:35:471
6805997325,10cyclictest0-21swapper/121:06:011
6805997324,9cyclictest301ktimers/119:16:031
679999733,42cyclictest11805-21runrttasks23:33:200
679999733,34cyclictest29790-21/usr/sbin/munin21:21:050
6799997326,13cyclictest6049-21fschecks_count20:30:510
6799997314,25cyclictest15-21ksoftirqd/022:29:120
681799723,31cyclictest21352-21chrt21:06:453
6812997251,8cyclictest181rcu_preempt20:50:522
6812997251,15cyclictest20351-21fschecks_time21:05:582
6812997213,33cyclictest39-21ksoftirqd/220:02:372
6812997212,36cyclictest39-21ksoftirqd/221:27:532
6805997256,10cyclictest1-21systemd19:30:311
6805997256,10cyclictest1-21systemd19:30:311
6805997248,15cyclictest0-21swapper/100:05:531
6805997224,11cyclictest301ktimers/121:21:051
6799997251,15cyclictest9316-21fschecks_time20:40:530
6799997251,15cyclictest1563-21sh20:16:010
6799997251,15cyclictest1563-21sh20:16:010
6799997245,23cyclictest6786-21cyclictest23:55:520
679999724,35cyclictest352-21runrttasks00:02:490
679999723,37cyclictest13254-21cat22:41:050
679999723,37cyclictest13254-21cat22:41:050
6799997230,13cyclictest181rcu_preempt20:10:320
6799997230,13cyclictest181rcu_preempt20:10:320
6799997227,11cyclictest181rcu_preempt20:21:060
6799997224,13cyclictest181rcu_preempt20:25:550
681799712,30cyclictest25623-21taskset21:15:203
6812997142,11cyclictest181rcu_preempt23:00:452
6812997131,11cyclictest4038-21ssh21:32:122
6812997131,11cyclictest4038-21ssh21:32:122
681299712,21cyclictest39-21ksoftirqd/219:25:482
681299712,21cyclictest39-21ksoftirqd/219:25:482
6812997119,35cyclictest39-21ksoftirqd/219:06:352
6812997115,33cyclictest39-21ksoftirqd/220:16:032
6812997115,33cyclictest39-21ksoftirqd/220:16:032
6805997152,13cyclictest3390-21kworker/u17:3-events_unbound23:31:061
6805997134,28cyclictest12624-21kworker/u18:2+nfsiod23:37:111
6805997125,8cyclictest301ktimers/123:41:041
6799997146,20cyclictest6786-21cyclictest22:05:320
679999714,35cyclictest6736-21fschecks_count22:30:530
679999713,38cyclictest20301-21ssh21:05:580
681799704,26cyclictest31663-21chrt21:25:293
681299709,24cyclictest39-21ksoftirqd/219:32:332
681299709,21cyclictest39-21ksoftirqd/220:00:342
681299706,21cyclictest39-21ksoftirqd/222:25:552
6812997041,9cyclictest181rcu_preempt20:25:492
6812997037,8cyclictest181rcu_preempt20:46:052
6812997034,15cyclictest25580-21kworker/u17:3-xprtiod21:21:262
6812997025,13cyclictest0-21swapper/223:06:032
6812997013,25cyclictest39-21ksoftirqd/220:30:592
680599704,43cyclictest352-21runrttasks20:37:011
680599703,51cyclictest7338-21latency_hist20:35:331
680599703,50cyclictest13037-21switchtime20:51:061
680599703,46cyclictest14638-21cpu21:50:461
6805997024,11cyclictest301ktimers/121:45:341
6805997021,8cyclictest301ktimers/121:30:321
6799997044,19cyclictest20577-21cut19:35:550
6799997039,9cyclictest15-21ksoftirqd/022:15:350
6799997039,9cyclictest15-21ksoftirqd/022:15:350
679999703,37cyclictest28895-21runrttasks20:00:590
6799997028,30cyclictest25011-21kworker/u17:1+nfsiod00:05:470
679999702,37cyclictest15-21ksoftirqd/021:30:490
679999702,37cyclictest15-21ksoftirqd/021:30:490
681799693,26cyclictest7199-21chrt18:55:533
681299696,26cyclictest39-21ksoftirqd/223:55:512
6812996945,13cyclictest0-21swapper/223:50:582
6812996943,9cyclictest181rcu_preempt19:46:042
6812996914,25cyclictest39-21ksoftirqd/219:00:502
6812996910,25cyclictest39-21ksoftirqd/200:05:012
6805996949,12cyclictest0-21swapper/123:11:061
680599693,45cyclictest29927-21latency_hist20:05:331
6805996925,8cyclictest301ktimers/122:00:311
6805996925,8cyclictest301ktimers/119:40:311
6805996925,7cyclictest301ktimers/119:00:391
6805996923,8cyclictest301ktimers/120:40:591
6805996919,28cyclictest31-21ksoftirqd/122:44:111
6805996919,28cyclictest31-21ksoftirqd/122:44:111
681799686,28cyclictest0-21swapper/323:45:333
681799683,28cyclictest24383-21taskset22:05:593
6812996819,20cyclictest371rcuc/221:13:112
6805996851,11cyclictest22333-21ssh23:50:561
6805996838,20cyclictest29789-21apt-key22:15:351
6805996838,20cyclictest29789-21apt-key22:15:351
680599683,47cyclictest28177-21latency_hist20:00:331
680599683,46cyclictest23482-21runrttasks19:45:341
6805996825,33cyclictest25964-21sed23:56:041
6805996824,9cyclictest301ktimers/122:20:451
6805996822,10cyclictest301ktimers/119:50:511
6799996828,8cyclictest181rcu_preempt19:55:310
162892680,8sleep10-21swapper/122:46:061
681799673,30cyclictest32031-21chrt00:06:083
681799672,29cyclictest8071-21chrt22:32:303
681799672,27cyclictest10021-21chrt22:35:583
6812996740,9cyclictest181rcu_preempt20:35:422
6805996750,11cyclictest21317-21ssh22:55:411
6805996750,11cyclictest21317-21ssh22:55:411
680599673,42cyclictest17629-21ntp_states21:01:031
6805996724,8cyclictest301ktimers/119:20:521
6805996724,8cyclictest301ktimers/119:20:521
6805996722,8cyclictest301ktimers/119:06:011
6805996714,16cyclictest16572-21ssh21:00:131
679999674,42cyclictest10638-21/usr/sbin/munin19:05:520
6799996742,16cyclictest9276-21ssh23:29:340
6799996739,10cyclictest181rcu_preempt18:55:460
679999673,51cyclictest9276-21grep19:00:550
679999672,32cyclictest26549-21kworker/u18:2+ext4-rsv-conversion20:10:520
679999672,32cyclictest26549-21kworker/u18:2+ext4-rsv-conversion20:10:520
681799662,32cyclictest5567-21chrt22:28:493
681799662,26cyclictest4083-21chrt00:15:283
681799662,26cyclictest4083-21chrt00:15:283
6805996641,16cyclictest1385-21kernelversion20:15:551
6805996641,16cyclictest1385-21kernelversion20:15:551
6805996630,8cyclictest301ktimers/100:10:591
6805996630,8cyclictest301ktimers/100:10:591
6805996623,8cyclictest301ktimers/120:11:591
6805996623,8cyclictest301ktimers/120:11:591
6805996622,9cyclictest301ktimers/119:35:311
6805996622,8cyclictest301ktimers/120:20:531
6805996622,7cyclictest301ktimers/119:10:541
6805996618,33cyclictest28495-21diskmemload23:06:231
6805996618,14cyclictest0-21swapper/100:03:381
6799996647,10cyclictest0-21swapper/023:00:460
6799996644,16cyclictest6786-21cyclictest19:15:330
681799653,29cyclictest8997-21chrt23:28:473
681799653,28cyclictest16497-21chrt21:53:223
681799653,20cyclictest31871-21chrt20:10:423
681799653,20cyclictest31871-21chrt20:10:423
6805996552,9cyclictest6786-21cyclictest21:16:251
6805996524,26cyclictest31-21ksoftirqd/122:31:171
6799996522,13cyclictest181rcu_preempt20:35:550
6799996519,12cyclictest181rcu_preempt00:20:330
681799644,22cyclictest8054-21chrt00:21:033
681799643,24cyclictest14401-21chrt20:55:543
681799642,23cyclictest14322-21taskset23:37:023
680599645,25cyclictest31-21ksoftirqd/122:06:021
6805996451,9cyclictest6786-21cyclictest23:25:561
680599643,38cyclictest3493-21/usr/sbin/munin22:25:581
6805996420,8cyclictest301ktimers/120:30:321
679999642,32cyclictest27750-21latency23:05:550
681799634,19cyclictest26152-21chrt23:03:143
681799634,14cyclictest805-21chrt23:15:463
681799633,25cyclictest12327-21chrt21:46:043
681799633,23cyclictest31083-21chrt23:11:043
681799633,22cyclictest9162-21chrt21:41:023
681799633,20cyclictest849-21chrt21:26:393
681799633,19cyclictest1565-21chrt20:16:013
681799633,19cyclictest1565-21chrt20:16:013
681799632,21cyclictest724-21taskset22:20:513
681799632,21cyclictest15925-21chrt19:20:563
681799632,21cyclictest15925-21chrt19:20:563
681799623,24cyclictest22849-21chrt23:51:093
681799623,24cyclictest19210-21chrt21:04:133
681799622,27cyclictest9938-21chrt23:30:423
681799622,24cyclictest3949-21chrt21:31:583
681799622,24cyclictest3949-21chrt21:31:583
681799622,24cyclictest26506-21chrt23:57:163
681799622,23cyclictest4413-21taskset20:25:493
681799622,22cyclictest26880-21chrt19:55:473
681799622,22cyclictest18858-21chrt19:30:483
681799622,22cyclictest10620-21chrt20:45:333
6805996221,7cyclictest301ktimers/100:15:521
681799617,13cyclictest0-21swapper/321:38:113
681799613,24cyclictest28150-21chrt00:00:493
681799613,22cyclictest6943-21chrt00:20:103
681799613,21cyclictest21924-21chrt22:01:083
681799613,20cyclictest28677-21chrt20:00:543
681799612,21cyclictest27865-21chrt23:05:573
681799612,21cyclictest19967-21chrt22:52:323
680599613,31cyclictest23567-21cpu19:45:471
681799603,21cyclictest28530-21chrt21:20:063
681799603,21cyclictest20532-21chrt19:35:553
681799603,20cyclictest12793-21chrt19:11:003
681799603,19cyclictest10465-21chrt19:05:333
681799602,22cyclictest25327-21taskset19:50:533
681799602,21cyclictest11907-21chrt20:48:333
681799602,20cyclictest28630-21chrt22:13:043
681799602,20cyclictest28630-21chrt22:13:043
681799602,20cyclictest21509-21chrt22:55:483
681799602,20cyclictest21509-21chrt22:55:483
681799602,19cyclictest6270-21chrt20:30:553
679999602,31cyclictest23538-21/usr/sbin/munin19:45:580
681799596,12cyclictest0-21swapper/319:06:023
681799592,24cyclictest15234-21chrt19:20:313
681799592,23cyclictest24701-21taskset19:48:063
681799592,22cyclictest12600-21chrt22:40:493
681799592,22cyclictest12600-21chrt22:40:493
681799592,21cyclictest8598-21chrt20:37:483
681799592,20cyclictest22675-21chrt19:41:053
681799592,20cyclictest13445-21chrt20:52:423
681799554,12cyclictest0-21swapper/318:55:343
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional