You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-07 - 10:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Fri Aug 07, 2026 00:44:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1173121076,16sleep10-21swapper/118:52:541
11272210530,40sleep00-21swapper/018:51:100
121609910344,39cyclictest29581-21fschecks_time19:45:520
121609910344,39cyclictest29581-21fschecks_time19:45:520
121609910333,29cyclictest0-21swapper/023:20:280
121609910333,29cyclictest0-21swapper/023:20:280
121609910237,34cyclictest4743-21ssh21:24:510
121609910236,33cyclictest2615-21ssh00:01:060
121609910135,39cyclictest11628-21taskset22:30:080
121729910059,34cyclictest4183-21sendmail00:05:251
12160999938,34cyclictest19665-21ssh22:41:500
12160999936,35cyclictest13385-21taskset21:38:480
12172999855,37cyclictest26768-21latency22:00:521
12160999831,26cyclictest0-21swapper/022:21:040
1218099973,66cyclictest10007-21apt-get23:20:442
12160999735,26cyclictest25552-21rm22:51:280
1217299963,27cyclictest352-21runrttasks22:51:481
12160999639,52cyclictest0-21swapper/023:20:540
12160999637,24cyclictest14453-21rm22:34:000
1199429635,43sleep30-21swapper/318:55:293
12160999536,23cyclictest4424-21rm22:17:240
12160999535,27cyclictest18598-21ssh23:35:120
12160999534,25cyclictest19433-21rm21:48:540
12180999417,46cyclictest39-21ksoftirqd/222:39:392
12180999417,46cyclictest39-21ksoftirqd/222:39:392
12172999455,32cyclictest11882-21ntp_kernel_pll_21:35:551
12160999456,27cyclictest5312-21apt-get21:25:380
12160999337,24cyclictest16802-21sh21:45:010
12160999337,24cyclictest16802-21sh21:45:010
12160999335,23cyclictest976-21taskset23:59:520
12160999335,21cyclictest25809-21sh22:00:000
12160999335,21cyclictest25809-21sh22:00:000
12160999334,26cyclictest31572-21ssh23:01:380
12160999333,25cyclictest1273-21runrttasks19:58:400
12160999330,25cyclictest0-21swapper/022:37:050
12160999330,25cyclictest0-21swapper/022:37:050
1218099923,65cyclictest12333-21ssh22:30:412
1217299922,26cyclictest352-21runrttasks19:26:231
12160999235,22cyclictest23430-21ssh22:48:560
12160999235,22cyclictest23430-21ssh22:48:560
12160999232,22cyclictest10608-21ssh21:34:250
12160999232,22cyclictest10608-21ssh21:34:250
12180999163,19cyclictest16669-21fschecks_count20:45:482
1217299913,81cyclictest0-21swapper/119:20:391
12160999135,26cyclictest21125-21ssh23:38:550
12160999135,22cyclictest1463-21ssh21:19:020
12160999135,21cyclictest26236-21sh23:46:240
12160999132,24cyclictest6129-21ssh00:07:280
118612916,68sleep20-21swapper/218:54:342
12172999048,35cyclictest4704-21timerandwakeup23:11:011
12172999048,35cyclictest4704-21timerandwakeup23:11:011
12172999048,34cyclictest0-21swapper/122:21:301
1217299904,78cyclictest0-21swapper/119:55:381
1217299903,38cyclictest29375-21/usr/sbin/munin21:10:561
12160999062,18cyclictest3812-21apt-get23:10:400
12160999062,18cyclictest3812-21apt-get23:10:400
12160999037,23cyclictest9113-21ssh00:12:280
12160999032,23cyclictest14302-21taskset20:36:560
12160999032,22cyclictest21524-21ssh20:57:530
12160999032,22cyclictest21524-21ssh20:57:530
12160998958,20cyclictest26088-21apt-get19:35:380
12160998953,26cyclictest3333-21apt-get20:05:370
12160998935,26cyclictest31134-21rm22:08:040
12160998935,20cyclictest29869-21users21:11:050
12160998934,26cyclictest28183-21ssh21:09:420
12160998934,26cyclictest14995-21ssh23:28:260
12160998932,21cyclictest12661-21ssh00:19:030
1218099886,61cyclictest6099-21ssh22:20:422
12172998847,34cyclictest0-21swapper/121:45:261
12172998847,34cyclictest0-21swapper/121:45:261
12172998841,41cyclictest0-21swapper/120:20:361
12172998841,41cyclictest0-21swapper/120:20:361
1217299882,28cyclictest352-21runrttasks20:02:281
12160998836,19cyclictest219812switchtime19:21:010
12160998830,23cyclictest24154-21ssh21:01:540
12160998829,33cyclictest0-21swapper/022:13:090
12172998753,28cyclictest277-21dbus-daemon23:50:261
12160998751,23cyclictest16489-21apt-get20:45:380
12160998748,23cyclictest22879-21apt-get19:25:420
12160998734,19cyclictest19457-21diskmemload00:24:060
12172998664,16cyclictest5042-21latency_hist21:25:291
1217299863,38cyclictest28864-21/usr/sbin/munin23:51:021
12160998664,14cyclictest352-21runrttasks19:10:450
12160998634,23cyclictest29284-21rm22:58:360
12160998630,24cyclictest11214-21kworker/u17:2+rpciod22:00:310
1217299855,71cyclictest0-21swapper/119:40:381
12160998536,19cyclictest2369-21/usr/sbin/munin20:00:590
12172998443,33cyclictest0-21swapper/121:55:541
12172998443,33cyclictest0-21swapper/121:55:541
12172998438,40cyclictest0-21swapper/123:20:251
12172998438,40cyclictest0-21swapper/123:20:251
1217299843,39cyclictest13207-21/usr/sbin/munin18:56:181
1217299842,25cyclictest10119-21apt-get23:20:541
12160998453,19cyclictest14853-21apt-get20:40:380
12160998449,22cyclictest4938-21apt-get20:10:410
12160998445,32cyclictest6821-21apt-get20:16:010
12160998445,32cyclictest6821-21apt-get20:16:010
12160998437,42cyclictest0-21swapper/023:40:380
12160998435,39cyclictest19617-21/usr/sbin/munin19:15:520
12160998435,39cyclictest19617-21/usr/sbin/munin19:15:520
12160998434,21cyclictest31433-21ntpq19:50:560
12160998433,41cyclictest27751-21/usr/sbin/munin19:40:430
12160998431,22cyclictest19457-21diskmemload21:52:000
12180998354,20cyclictest11746-21latency_hist22:30:292
1218099834,55cyclictest19457-21diskmemload23:31:512
1217299834,74cyclictest0-21swapper/122:15:371
1217299834,74cyclictest0-21swapper/119:45:401
1217299834,74cyclictest0-21swapper/119:45:401
1217299834,69cyclictest0-21swapper/123:05:401
1217299833,75cyclictest0-21swapper/100:15:401
1217299833,72cyclictest0-21swapper/119:30:371
1217299833,69cyclictest0-21swapper/120:45:391
1217299833,37cyclictest15941-21ssh22:36:001
1217299833,37cyclictest15941-21ssh22:36:001
1217299833,34cyclictest19216-21sh23:35:481
12160998348,26cyclictest828-21apt-get23:05:390
12160998346,28cyclictest11951-21apt-get18:55:450
1217299826,71cyclictest0-21swapper/121:00:401
1217299826,68cyclictest0-21swapper/119:05:391
1217299824,73cyclictest0-21swapper/123:00:401
1217299823,34cyclictest26971-21unixbench_multi19:36:031
12160998263,10cyclictest27996-21apt-get23:50:390
12160998262,10cyclictest10026-21apt-get20:25:400
12160998221,32cyclictest14762-21/usr/sbin/munin19:01:460
12180998121,27cyclictest39-21ksoftirqd/222:11:312
1217299814,70cyclictest7520-21ssh00:10:381
1217299813,70cyclictest0-21swapper/120:30:411
1217299813,70cyclictest0-21swapper/120:20:431
1217299813,68cyclictest13497-21ssh00:20:381
1217299813,37cyclictest9426-21/usr/sbin/munin22:25:511
1217299813,36cyclictest18442-21ssh23:34:451
1217299813,34cyclictest15500-21mailstats20:40:581
1217299812,36cyclictest13499-21sed22:32:041
1217299812,35cyclictest18595-21fschecks_time22:40:491
1217299812,34cyclictest21730-21rm21:51:571
1217299812,31cyclictest18104-21apt-get20:50:371
12180998020,27cyclictest39-21ksoftirqd/222:56:162
12172998039,34cyclictest0-21swapper/120:10:581
1217299803,38cyclictest17711-21runrttasks21:45:501
1217299803,35cyclictest18314-21/usr/sbin/munin19:10:501
1217299803,34cyclictest5787-21latency21:25:541
1217299803,34cyclictest365-21sh22:10:551
1217299803,33cyclictest14328-21store19:00:311
1217299803,33cyclictest13653-21/usr/sbin/munin20:35:501
1217299803,30cyclictest31156-21/usr/sbin/munin19:50:491
12180997947,12cyclictest181rcu_preempt00:15:542
1218099793,47cyclictest13648-21ntp_offset23:25:562
1218099792,59cyclictest7092-21kworker/u18:2+ext4-rsv-conversion19:01:062
12180997925,13cyclictest181rcu_preempt20:16:262
12180997925,13cyclictest181rcu_preempt20:16:262
1217299793,65cyclictest0-21swapper/120:25:401
1217299793,37cyclictest21514-21/usr/sbin/munin22:45:471
1217299793,37cyclictest21514-21/usr/sbin/munin22:45:471
1217299792,6cyclictest0-21swapper/121:05:431
1217299792,39cyclictest27302-21ssh22:55:401
1217299792,38cyclictest10970-21modprobe21:35:261
1217299792,38cyclictest10970-21modprobe21:35:261
1217299792,37cyclictest20979-21/usr/sbin/munin19:20:281
1217299792,37cyclictest20979-21/usr/sbin/munin19:20:281
1217299792,36cyclictest31757-21ssh21:15:371
1217299792,34cyclictest19779-21rm20:55:371
1217299792,34cyclictest19779-21rm20:55:371
1217299792,33cyclictest15737-21ssh23:30:261
1218099783,41cyclictest27914-21fschecks_time19:40:492
12180997832,12cyclictest0-21swapper/221:33:402
12180997832,12cyclictest0-21swapper/221:33:402
1217299783,71cyclictest0-21swapper/120:05:371
1217299783,34cyclictest471-21seq23:58:281
12160997847,21cyclictest16427-21apt-get19:05:430
12160997837,34cyclictest18085-21/usr/sbin/munin20:50:520
12160997834,23cyclictest25488-21taskset19:31:170
1217299775,67cyclictest0-21swapper/122:05:391
1217299773,34cyclictest22619-21ntpq23:40:571
1217299773,32cyclictest6935-21rm00:09:441
12160997740,28cyclictest8899-21ntpq20:20:560
12180997639,8cyclictest181rcu_preempt22:49:422
12180997639,8cyclictest181rcu_preempt22:49:422
12180997621,27cyclictest39-21ksoftirqd/221:07:262
12160997649,18cyclictest11638-21apt-get20:30:400
12180997536,8cyclictest181rcu_preempt20:14:002
12180997523,21cyclictest39-21ksoftirqd/220:35:272
12180997521,20cyclictest39-21ksoftirqd/221:13:382
12180997453,15cyclictest22980-21latency_hist21:55:292
12180997452,16cyclictest4902-21if_err_eth000:05:512
12180997451,7cyclictest181rcu_preempt21:20:592
12180997444,8cyclictest181rcu_preempt19:54:572
12180997425,27cyclictest0-21swapper/220:38:142
12180997358,11cyclictest12151-21cyclictest00:02:552
12180997352,15cyclictest23676-21sh21:01:032
12180997341,8cyclictest181rcu_preempt19:55:512
12180997338,8cyclictest181rcu_preempt21:36:582
12180997338,8cyclictest181rcu_preempt00:13:462
12180997337,7cyclictest181rcu_preempt22:06:012
12180997320,21cyclictest39-21ksoftirqd/222:00:592
12180997313,22cyclictest381ktimers/220:50:422
12180997249,9cyclictest181rcu_preempt22:16:032
12180997227,20cyclictest0-21swapper/222:42:112
12180997220,20cyclictest39-21ksoftirqd/220:56:422
12180997220,20cyclictest39-21ksoftirqd/220:56:422
12180997151,7cyclictest181rcu_preempt19:27:182
12180997141,20cyclictest0-21swapper/220:05:292
12180997139,9cyclictest181rcu_preempt23:15:452
12180997139,9cyclictest181rcu_preempt23:15:452
12180997139,7cyclictest181rcu_preempt21:19:562
12180997137,7cyclictest181rcu_preempt21:50:182
12180997126,21cyclictest0-21swapper/220:06:072
12180997052,10cyclictest0-21swapper/223:45:492
12180997044,7cyclictest181rcu_preempt23:14:042
12180997044,7cyclictest181rcu_preempt23:14:042
12180997040,11cyclictest181rcu_preempt18:55:362
1218099703,49cyclictest21746-21latency_hist23:40:272
12180997034,10cyclictest181rcu_preempt23:59:472
12180997018,19cyclictest39-21ksoftirqd/221:45:012
12180997018,19cyclictest39-21ksoftirqd/221:45:012
12180996936,7cyclictest181rcu_preempt23:02:252
1218099693,43cyclictest27074-21latency_hist22:55:282
12180996926,20cyclictest0-21swapper/223:54:172
1218099692,42cyclictest24877-21latency_hist23:45:302
12180996924,21cyclictest39-21ksoftirqd/221:55:542
12180996924,21cyclictest39-21ksoftirqd/221:55:542
12180996847,8cyclictest181rcu_preempt20:40:462
12180996838,10cyclictest181rcu_preempt21:30:052
1218099683,40cyclictest19457-21diskmemload23:08:102
12180996830,9cyclictest181rcu_preempt20:21:042
12180996828,18cyclictest0-21swapper/219:25:112
12180996823,17cyclictest0-21swapper/219:08:272
12180996729,8cyclictest0-21swapper/200:22:012
1218099663,28cyclictest20978-21apt19:20:262
1218099663,28cyclictest20978-21apt19:20:262
12180996631,11cyclictest0-21swapper/219:36:302
1218099653,41cyclictest10280-21fschecks_time20:25:472
12180996514,22cyclictest381ktimers/219:30:412
12180996444,7cyclictest181rcu_preempt19:12:142
12180996424,17cyclictest0-21swapper/219:49:432
12180996424,17cyclictest0-21swapper/219:49:432
1219599598,37cyclictest0-21swapper/320:16:103
1219599598,37cyclictest0-21swapper/320:16:103
1219599582,39cyclictest15025-21taskset19:01:523
1219599573,36cyclictest29797-21chrt21:11:043
12195995420,21cyclictest17439-21chrt20:46:033
12195995319,22cyclictest14229-21taskset19:00:313
12195995313,27cyclictest12401-21taskset21:36:053
1219599523,33cyclictest4399-21chrt00:05:293
1219599522,33cyclictest27988-21chrt21:09:093
1219599522,33cyclictest23833-21chrt19:26:033
12195995218,22cyclictest28228-21chrt19:40:573
12195995215,24cyclictest19788-21taskset20:55:393
12195995215,24cyclictest19788-21taskset20:55:393
12195995214,25cyclictest32610-21chrt23:57:343
12195995214,25cyclictest13835-21taskset22:32:153
1219599512,32cyclictest11071-21taskset22:28:343
12195995120,20cyclictest18092-21chrt20:50:373
12195995119,20cyclictest5548-21chrt22:20:263
12195995112,25cyclictest28735-21chrt22:57:033
12195995110,28cyclictest15495-21taskset22:35:473
12195995110,28cyclictest15495-21taskset22:35:473
1219599503,34cyclictest10318-21taskset21:33:373
1219599503,34cyclictest10318-21taskset21:33:373
1219599503,32cyclictest28311-21chrt22:03:373
1219599502,33cyclictest31517-21taskset23:01:293
1219599502,33cyclictest24270-21chrt21:56:033
1219599502,33cyclictest24270-21chrt21:56:033
1219599502,32cyclictest31222-21taskset22:08:193
12195995019,20cyclictest8621-21chrt22:25:093
12195995015,22cyclictest25217-21chrt23:45:473
12195995014,24cyclictest7600-21chrt00:10:433
12195995013,24cyclictest23351-21taskset23:41:463
1219599493,31cyclictest7876-21chrt23:16:043
1219599493,31cyclictest7876-21chrt23:16:043
12195994919,19cyclictest14855-21chrt20:40:363
12195994918,20cyclictest17958-21chrt21:45:573
12195994917,20cyclictest14751-21chrt00:21:293
12195994916,21cyclictest21092-21chrt21:51:003
12195994915,22cyclictest11988-21chrt20:30:523
12195994915,21cyclictest857-21chrt23:05:423
12195994915,21cyclictest27316-21chrt19:39:113
12195994914,23cyclictest31945-21taskset21:15:463
12195994912,25cyclictest21819-21taskset22:45:533
12195994912,25cyclictest21819-21taskset22:45:533
12195994911,24cyclictest30565-21taskset19:49:163
12195994911,24cyclictest30565-21taskset19:49:163
12195994817,20cyclictest880-21chrt19:56:083
12195994817,20cyclictest30608-21chrt23:55:193
12195994815,22cyclictest8406-21chrt20:20:433
12195994815,21cyclictest18105-21chrt19:10:443
12195994814,22cyclictest12820-21chrt23:25:283
12195994812,25cyclictest13073-21taskset00:20:123
12195994715,21cyclictest17577-21chrt19:08:123
12195994715,21cyclictest16141-21chrt21:43:103
12195994715,21cyclictest16141-21chrt21:43:103
12195994714,21cyclictest21497-21chrt19:20:483
12195994714,20cyclictest18480-21chrt22:40:463
12195994714,20cyclictest10030-21chrt20:25:373
1219599466,29cyclictest26249-21chrt22:53:263
1219599463,28cyclictest20112-21taskset19:15:543
1219599463,28cyclictest20112-21taskset19:15:543
1219599463,25cyclictest1761-21taskset20:00:423
12195994628,10cyclictest22432sleep321:20:323
1219599462,28cyclictest3628-21chrt20:05:483
12195994615,19cyclictest361-21chrt22:10:543
12195994614,20cyclictest24479-21chrt19:30:363
12195994613,22cyclictest21609-21taskset23:40:163
1219599453,28cyclictest6141-21taskset23:14:303
1219599453,28cyclictest6141-21taskset23:14:303
1219599452,32cyclictest31218-21chrt19:50:503
12195994515,20cyclictest5685-21chrt21:25:513
12195994515,20cyclictest18897-21chrt23:35:293
12195994512,22cyclictest23976-21chrt21:01:233
1219599443,29cyclictest5918-21taskset20:11:033
12195994415,19cyclictest5884-21chrt00:06:463
12195994410,23cyclictest13004-21taskset23:25:333
1219599433,28cyclictest13389-21taskset20:35:423
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional