You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-08 - 06:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Mon Jun 08, 2026 00:44:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
983021267,21sleep10-21swapper/118:55:171
10531991214,45cyclictest16313-21ssh23:39:440
10531991214,45cyclictest16313-21ssh23:39:440
105319910953,48cyclictest0-21swapper/021:59:350
105319910946,55cyclictest4476-21ssh23:19:470
105379910761,39cyclictest298-21in:imuxsock22:11:131
105379910761,39cyclictest298-21in:imuxsock22:11:131
105319910538,60cyclictest0-21swapper/000:09:310
10531991053,11cyclictest0-21swapper/018:59:360
10531991052,22cyclictest1978-21ssh00:09:540
10531991033,28cyclictest5715-21xargs00:15:070
105319910268,27cyclictest0-21swapper/021:59:560
105379910183,12cyclictest11098-21latency18:59:571
105319910166,25cyclictest0-21swapper/023:15:060
1053199995,37cyclictest21222-21fschecks_count21:04:540
1053199995,37cyclictest21222-21fschecks_count21:04:540
1053199994,24cyclictest22820-21mailstats22:55:070
1053199993,32cyclictest17627-21seq19:19:480
1053199993,32cyclictest17627-21seq19:19:480
1053199993,30cyclictest352-21runrttasks23:10:260
1053199993,29cyclictest21071-21runrttasks22:52:390
1053199993,26cyclictest1-21systemd23:34:320
1053199992,24cyclictest27590-21ntp_states21:15:010
1053199992,24cyclictest27590-21ntp_states21:15:010
10537999851,39cyclictest0-21swapper/100:14:541
10531999883,9cyclictest27214-21latency_hist19:49:350
10531999860,29cyclictest0-21swapper/022:37:350
10531999860,29cyclictest0-21swapper/022:37:350
10531999844,47cyclictest32421-21ssh22:16:420
10531999844,47cyclictest32421-21ssh22:16:420
10531999843,49cyclictest7214-21timerwakeupswit20:25:090
10531999843,49cyclictest7214-21timerwakeupswit20:25:090
10537999751,41cyclictest0-21swapper/120:59:311
10531999745,46cyclictest9711-21ssh21:39:470
1053199974,31cyclictest17689-21diskmemload23:34:470
10531999734,56cyclictest0-21swapper/023:57:450
1053199972,43cyclictest4513-21latency_hist20:19:350
10537999650,39cyclictest0-21swapper/119:34:341
1053199965,27cyclictest18245-21fschecks_count20:59:540
1053199965,27cyclictest18245-21fschecks_count20:59:540
1053199963,27cyclictest8222-21diskmemload21:36:580
10531999632,55cyclictest0-21swapper/022:20:110
10531999632,55cyclictest0-21swapper/022:20:110
1053199962,22cyclictest13073-21/usr/sbin/munin20:45:120
1053199944,33cyclictest10259-21latency_hist23:29:350
1053199944,33cyclictest10259-21latency_hist23:29:350
10531999435,52cyclictest0-21swapper/021:27:480
1053199943,33cyclictest2908-21latency_hist20:14:340
1053199943,32cyclictest14886-21diskstats20:49:530
1053199943,32cyclictest14886-21diskstats20:49:530
1053199943,30cyclictest7069-21latency_hist22:29:350
1053199943,30cyclictest7069-21latency_hist22:29:350
1053199943,30cyclictest12749-21/usr/sbin/munin19:04:450
1053199943,28cyclictest9811-21latency_hist20:34:360
1053199942,38cyclictest17689-21diskmemload23:03:020
1053199942,38cyclictest17689-21diskmemload23:03:020
1053199942,32cyclictest31243-21unixbench_multi21:20:540
1053199942,32cyclictest10098-21diskstats20:36:070
10545999311,59cyclictest9688-21apt-get21:39:522
1053199934,83cyclictest0-21swapper/022:39:480
1053199934,82cyclictest10417-21modprobe00:24:310
1053199934,30cyclictest27393-21latency_hist22:09:330
1053199933,35cyclictest32331-21latency_hist20:04:360
1053199933,35cyclictest32331-21latency_hist20:04:360
1053199933,27cyclictest3755-21cut21:29:550
1053199933,27cyclictest21961-40mandb23:49:340
1053199933,27cyclictest21961-40mandb23:49:340
1053199933,27cyclictest21961-40mandb23:49:340
1053199933,27cyclictest16263-21grep19:14:550
1053199933,24cyclictest12888-21runrttasks20:44:340
10531999320,22cyclictest25016-21unixbench_multi21:10:100
1053199924,28cyclictest28308-21idleruntime23:04:540
1053199923,35cyclictest20841-21/usr/sbin/munin19:30:000
1053199923,34cyclictest22883-21ls23:50:410
1053199923,34cyclictest22883-21ls23:50:410
10531999224,61cyclictest0-21swapper/022:09:470
10531999224,61cyclictest0-21swapper/022:09:470
1053199922,34cyclictest10821-21grep00:24:480
1053199922,34cyclictest10821-21grep00:24:480
10537999151,34cyclictest15999-21sh21:49:581
1053199918,11cyclictest0-21swapper/022:44:500
1053199918,11cyclictest0-21swapper/022:44:500
1053199915,14cyclictest7229-21apt-get22:29:440
1053199913,32cyclictest17835-21chrt20:59:350
1053199913,28cyclictest20675-21latency_hist19:29:340
1053199912,21cyclictest29278-21/usr/sbin/munin00:00:110
10531999110,27cyclictest13179-21latency21:45:000
10531999110,27cyclictest13179-21latency21:45:000
10537999070,13cyclictest10418-21fschecks_count22:34:541
10537999070,13cyclictest10418-21fschecks_count22:34:541
10537999068,16cyclictest15747-21cron19:14:321
10537999051,32cyclictest0-21swapper/121:55:091
10537999048,37cyclictest0-21swapper/121:24:551
10537999047,35cyclictest0-21swapper/121:00:071
10537999047,35cyclictest0-21swapper/121:00:071
10537999047,34cyclictest0-21swapper/123:51:411
10537999047,34cyclictest0-21swapper/123:51:411
10537999043,40cyclictest17689-21diskmemload22:57:461
1053199907,12cyclictest0-21swapper/021:54:020
1053199903,34cyclictest14384-21/usr/sbin/munin19:09:560
1053199903,33cyclictest4957-21fschecks_count20:19:530
1053199903,33cyclictest32550-21cstates20:05:470
1053199903,32cyclictest23427-21grep19:35:080
1053199903,26cyclictest30276-21awk19:59:320
1053199902,33cyclictest24513-21load19:39:570
10537998948,35cyclictest0-21swapper/119:50:011
1053199894,34cyclictest10697-21/usr/sbin/munin19:00:060
1053199893,27cyclictest28255-21unixbench_singl19:50:100
967928814,46sleep29724-21mailstats18:55:132
10537998850,31cyclictest0-21swapper/119:24:341
10537998850,31cyclictest0-21swapper/119:24:341
10537998849,32cyclictest0-21swapper/123:34:541
10537998847,34cyclictest0-21swapper/120:02:201
10537998847,34cyclictest0-21swapper/120:02:201
10537998749,31cyclictest0-21swapper/123:09:341
10537998749,31cyclictest0-21swapper/100:14:341
10537998746,35cyclictest0-21swapper/123:58:361
10537998746,35cyclictest0-21swapper/120:06:001
10537998746,34cyclictest17689-21diskmemload21:12:011
10545998665,15cyclictest24077-21sh21:09:482
1053799863,37cyclictest28483-21/usr/sbin/munin23:59:551
1053799863,37cyclictest16140-21ssh22:44:491
1053799863,37cyclictest16140-21ssh22:44:491
10537998546,31cyclictest0-21swapper/100:22:241
10537998544,36cyclictest10522-21cyclictest21:15:081
10537998544,36cyclictest10522-21cyclictest21:15:081
1053799854,42cyclictest13737-21/usr/sbin/munin19:05:111
10537998442,34cyclictest0-21swapper/121:44:571
10537998442,34cyclictest0-21swapper/121:44:571
10537998441,36cyclictest0-21swapper/120:44:571
10545998358,17cyclictest25007-21acpi22:59:432
10545998358,17cyclictest25007-21acpi22:59:432
10537998362,11cyclictest0-21swapper/120:44:341
10537998360,16cyclictest13476-21latency_hist00:29:341
10537998360,16cyclictest13476-21latency_hist00:29:341
1053799834,10cyclictest0-21swapper/123:24:451
1053799834,10cyclictest0-21swapper/123:24:451
1053799833,37cyclictest22548-21timerandwakeup22:00:091
1053799833,36cyclictest24806-21seq22:04:501
1053799833,34cyclictest7057-21ntp_kernel_pll_21:35:001
1053799832,37cyclictest4881-21sh22:25:041
1053799832,37cyclictest4881-21sh22:25:041
10537998239,34cyclictest0-21swapper/119:54:571
1053799823,36cyclictest16007-21cut22:44:351
1053799823,36cyclictest1337-21latency_hist00:09:341
1053799823,35cyclictest23330-21timerwakeupswit19:35:071
1053799822,34cyclictest19602-21memory22:49:581
10545998161,14cyclictest24313-21latency_hist22:04:352
10537998160,9cyclictest0-21swapper/120:29:351
10537998160,9cyclictest0-21swapper/120:29:351
10537998158,16cyclictest10851-21ssh21:40:451
10537998144,30cyclictest0-21swapper/120:20:021
1053799814,35cyclictest31737-21ssh22:16:151
1053799814,35cyclictest31737-21ssh22:16:151
1053799814,34cyclictest26409-21sort19:45:061
1053799813,37cyclictest8208-21fschecks_count20:29:541
1053799812,41cyclictest7248-21ssh22:29:471
10545998061,14cyclictest9072-21kworker/u17:1+events_unbound23:49:312
10545998061,14cyclictest9072-21kworker/u17:1+events_unbound23:49:312
10545998061,14cyclictest9072-21kworker/u17:1+events_unbound23:49:312
1053799809,23cyclictest387-21ls21:24:351
10537998053,20cyclictest27350-21sshd23:03:411
10537998053,20cyclictest27350-21sshd23:03:411
1053799802,38cyclictest1203-21unin-run23:14:331
1053799794,34cyclictest16280-21/usr/sbin/munin23:39:561
1053799794,34cyclictest16280-21/usr/sbin/munin23:39:561
1053799794,33cyclictest3157-21/usr/sbin/munin20:14:501
1053799793,38cyclictest10956-21/usr/sbin/munin23:30:011
1053799793,37cyclictest9861-21apt-get20:34:451
1053799793,36cyclictest1774-21fschecks_count20:09:551
1053799793,29cyclictest4527-21/usr/sbin/munin23:19:481
1053799792,36cyclictest19513-21idleruntime19:24:551
1053799792,32cyclictest14987-21cut20:49:541
1053799792,32cyclictest14987-21cut20:49:541
10537997913,22cyclictest4058-21nfs4_client21:30:011
10545997857,15cyclictest10522-21cyclictest23:58:122
10545997856,15cyclictest4999-21sh21:31:162
10545997848,22cyclictest22297-21fschecks_count22:54:552
1053799783,24cyclictest1800-21/usr/sbin/munin22:20:001
1053799783,24cyclictest1800-21/usr/sbin/munin22:20:001
1053799782,37cyclictest4183-21latency_hist23:19:331
10545997756,14cyclictest19676-21snmpd22:26:292
10545997756,14cyclictest19676-21snmpd22:26:292
1053799774,29cyclictest352-21runrttasks19:40:471
1053799773,32cyclictest16227-21fschecks_count19:14:551
1053799772,36cyclictest20136-21timerandwakeup23:45:081
1053799772,36cyclictest20136-21timerandwakeup23:45:081
1053799772,36cyclictest20136-21timerandwakeup23:45:081
1053799772,35cyclictest17689-21diskmemload21:04:561
1053799772,35cyclictest17689-21diskmemload21:04:561
10545997654,17cyclictest10522-21cyclictest23:40:062
10545997654,17cyclictest10522-21cyclictest23:40:062
10545997558,11cyclictest883-21interrupts21:24:572
1054599749,54cyclictest1905-21apt-get00:09:512
10545997445,20cyclictest9589-21apt-key21:39:362
10545997411,37cyclictest17689-21diskmemload21:53:442
10545997351,16cyclictest10522-21cyclictest22:36:052
10545997351,16cyclictest10522-21cyclictest22:36:052
1054599732,33cyclictest39-21ksoftirqd/222:14:192
1054599732,33cyclictest39-21ksoftirqd/222:14:192
10545997213,47cyclictest32377-21apt-get20:04:572
1055199713,54cyclictest22268-21taskset22:00:023
10545997151,14cyclictest16186-21fschecks_count19:14:552
10545997150,14cyclictest0-21swapper/223:59:472
10545997149,12cyclictest0-21swapper/221:05:112
10545997149,12cyclictest0-21swapper/221:05:112
10545997051,13cyclictest352-21runrttasks22:04:572
10545997047,15cyclictest0-21swapper/221:20:512
1054599704,40cyclictest22690-21sort19:34:532
10545997042,19cyclictest19782-21sh21:02:022
10545997042,19cyclictest19782-21sh21:02:022
1055199694,54cyclictest14052-21taskset21:45:563
1055199694,54cyclictest14052-21taskset21:45:563
1055199693,54cyclictest1259-21taskset23:14:343
1055199693,53cyclictest12617-21taskset23:33:223
1055199692,35cyclictest31404-21chrt22:16:063
1055199692,35cyclictest31404-21chrt22:16:063
10545996946,14cyclictest0-21swapper/220:14:592
1054599694,52cyclictest8315-21uptime22:30:102
10545996928,8cyclictest181rcu_preempt00:20:392
1055199683,34cyclictest3584-21chrt00:11:483
1055199683,34cyclictest17773-21taskset21:52:573
1055199683,30cyclictest30738-21chrt21:20:423
1055199682,36cyclictest30095-21chrt23:08:023
10545996854,10cyclictest10522-21cyclictest19:44:572
10545996853,9cyclictest0-21swapper/223:19:452
10545996847,16cyclictest13106-21sh00:28:452
10545996847,16cyclictest13106-21sh00:28:452
10545996847,14cyclictest7689-21latency_hist00:19:352
10545996843,18cyclictest30103-21sh21:19:522
10545996843,18cyclictest30103-21sh21:19:522
1054599683,47cyclictest373-21lldpd19:29:352
1054599683,47cyclictest15493-21cat20:50:072
1054599683,47cyclictest15493-21cat20:50:072
1054599683,43cyclictest30320-21apt-get22:14:472
1054599683,43cyclictest30320-21apt-get22:14:472
1055199673,51cyclictest24535-21chrt21:10:003
1055199673,51cyclictest11347-21chrt21:41:423
1055199672,53cyclictest25062-21chrt23:54:343
1055199672,53cyclictest25062-21chrt23:54:343
1055199672,34cyclictest28698-21taskset21:16:533
1055199672,34cyclictest28698-21taskset21:16:533
10545996754,9cyclictest10522-21cyclictest23:07:472
10545996751,9cyclictest0-21swapper/219:19:542
10545996751,9cyclictest0-21swapper/219:19:542
10545996741,6cyclictest181rcu_preempt22:45:422
10545996741,6cyclictest181rcu_preempt22:45:422
10545996737,17cyclictest0-21swapper/221:45:282
10545996737,17cyclictest0-21swapper/221:45:282
1054599673,47cyclictest30267-21apt19:59:322
1054599673,42cyclictest13454-21kernelversion20:44:582
10545996730,9cyclictest181rcu_preempt20:04:002
10545996730,9cyclictest181rcu_preempt20:04:002
1055199663,51cyclictest2789-21chrt23:15:443
1055199663,50cyclictest14859-21chrt20:49:493
1055199663,50cyclictest14859-21chrt20:49:493
1055199663,34cyclictest28565-21chrt19:53:283
1055199662,35cyclictest1777-21chrt21:25:403
1055199662,32cyclictest32621-21taskset20:05:513
10545996651,9cyclictest32027-21/usr/sbin/munin00:05:082
10545996645,14cyclictest544-21cron19:14:322
1054599664,39cyclictest25066-21latency_hist23:54:342
1054599664,39cyclictest25066-21latency_hist23:54:342
10545996640,7cyclictest181rcu_preempt23:16:002
1054599663,40cyclictest1311-21ssh23:14:352
10545996613,32cyclictest39-21ksoftirqd/219:01:322
253802650,8sleep30-21swapper/323:54:503
1055199653,49cyclictest8206-21chrt21:36:553
1055199653,30cyclictest4858-21chrt22:25:023
1055199653,30cyclictest4858-21chrt22:25:023
1055199653,29cyclictest14410-21chrt19:09:463
1055199652,38cyclictest25043-21taskset22:59:473
1055199652,38cyclictest25043-21taskset22:59:473
1055199652,35cyclictest11165-21taskset18:59:583
1055199652,33cyclictest3877-21chrt22:24:253
1055199652,33cyclictest3877-21chrt22:24:253
1055199652,32cyclictest16627-21taskset22:45:003
1055199652,32cyclictest16627-21taskset22:45:003
1055199652,32cyclictest10474-21chrt00:24:333
1055199652,30cyclictest22911-21chrt19:34:573
1054599654,42cyclictest13321-21/usr/sbin/munin23:34:532
1054599654,41cyclictest9701-21sed20:34:352
10545996543,8cyclictest181rcu_preempt23:32:082
1054599654,38cyclictest16605-21fschecks_time20:54:532
1054599654,37cyclictest12782-21cpu19:04:512
1055199643,31cyclictest12034-21chrt22:37:183
1055199643,31cyclictest12034-21chrt22:37:183
1055199643,29cyclictest21009-21chrt21:04:443
1055199643,29cyclictest21009-21chrt21:04:443
1055199643,29cyclictest17469-21taskset23:40:193
1055199643,29cyclictest17469-21taskset23:40:193
1055199642,37cyclictest30462-21chrt00:03:333
1055199642,32cyclictest8512-21taskset20:30:013
1055199642,31cyclictest4436-21taskset20:18:433
1055199642,31cyclictest13207-21chrt19:05:003
1055199642,27cyclictest5056-21taskset23:20:013
1054599644,32cyclictest352-21runrttasks19:34:102
10545996437,17cyclictest0-21swapper/222:39:532
1054599643,39cyclictest6118-21latency_hist20:24:362
1054599643,39cyclictest3481-21ssh22:23:182
1054599643,39cyclictest3481-21ssh22:23:182
1055199633,34cyclictest5361-21chrt20:20:043
1055199633,30cyclictest5142-21taskset21:31:403
1055199633,30cyclictest14921-21taskset23:36:303
1055199633,29cyclictest24833-21chrt22:04:533
1055199633,27cyclictest21866-21chrt23:49:273
1055199633,27cyclictest21866-21chrt23:49:273
1055199633,27cyclictest21866-21chrt23:49:273
1055199632,32cyclictest26726-21chrt19:45:553
1055199632,30cyclictest20944-21chrt21:58:283
1055199632,30cyclictest16323-21taskset19:14:573
1055199632,29cyclictest31132-21chrt00:04:433
1055199632,29cyclictest18035-21chrt20:59:463
1055199632,29cyclictest18035-21chrt20:59:463
1055199632,22cyclictest22715-21chrt22:55:053
10545996344,7cyclictest181rcu_preempt20:41:422
1054599634,43cyclictest10737-21timerandwakeup20:36:242
10545996339,13cyclictest0-21swapper/220:29:352
10545996339,13cyclictest0-21swapper/220:29:352
1054599633,43cyclictest19293-21runrttasks21:55:042
1054599633,29cyclictest8146-21/usr/sbin/munin23:25:052
1054599633,29cyclictest8146-21/usr/sbin/munin23:25:052
1055199623,28cyclictest28038-21chrt22:09:563
1055199623,28cyclictest28038-21chrt22:09:563
1055199623,28cyclictest21682-21chrt22:54:243
1055199623,28cyclictest12196-21chrt00:26:083
1055199623,28cyclictest12196-21chrt00:26:083
1055199622,31cyclictest9905-21chrt20:35:113
1055199622,30cyclictest5258-21chrt00:14:573
1055199622,30cyclictest14560-21chrt22:41:033
1055199622,29cyclictest7556-21chrt20:27:303
1055199622,29cyclictest7556-21chrt20:27:303
10545996242,7cyclictest181rcu_preempt20:11:562
1054599623,42cyclictest27566-21fschecks_time19:49:552
10545996227,9cyclictest181rcu_preempt19:43:142
1055199613,30cyclictest2942-21chrt20:14:343
1055199613,29cyclictest7423-21chrt22:29:523
1055199613,28cyclictest31786-21chrt20:03:333
1055199613,28cyclictest31786-21chrt20:03:333
1055199613,28cyclictest30215-21chrt19:59:033
1055199613,28cyclictest19231-21chrt19:24:453
1055199613,28cyclictest13099-21chrt20:44:473
1055199612,27cyclictest17594-21chrt19:19:383
1055199612,27cyclictest17594-21chrt19:19:383
10545996143,6cyclictest181rcu_preempt22:51:532
1055199603,27cyclictest12722-21chrt20:43:213
1055199603,26cyclictest25159-21chrt19:41:253
1055199602,28cyclictest9840-21chrt23:29:013
1055199602,28cyclictest9840-21chrt23:29:013
1055199602,26cyclictest20835-21chrt19:29:393
1055199592,27cyclictest17429-21chrt20:56:263
907025011,25sleep30-21swapper/318:54:503
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional