You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-30 - 21:49
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Sat May 30, 2026 12:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9587213390,24sleep20-21swapper/206:55:472
907121358,93sleep19111-21cstates06:55:261
10476991263,38cyclictest12375-21fschecks_count07:05:150
10476991154,34cyclictest352-21runrttasks10:16:070
10476991154,34cyclictest352-21runrttasks10:16:070
104809911237,41cyclictest20548-21sh10:52:131
104769910947,16cyclictest24739-21unixbench_multi09:10:450
1020921056,16sleep00-21swapper/006:58:310
104809910465,33cyclictest20439-21latency_hist09:05:081
1048099993,29cyclictest352-21runrttasks11:41:301
10476999846,24cyclictest15-21ksoftirqd/011:50:490
1048099972,62cyclictest7147-21apt-get10:30:261
10490999646,43cyclictest298-21in:imuxsock09:00:072
10490999646,43cyclictest298-21in:imuxsock09:00:072
10480999452,36cyclictest1-21systemd11:40:071
10480999452,36cyclictest1-21systemd11:40:071
1048099943,36cyclictest24017-21apt-get07:40:211
1048099943,36cyclictest24017-21apt-get07:40:211
10476999471,15cyclictest1-21systemd07:15:380
10490999337,48cyclictest0-21swapper/212:00:282
1049099933,28cyclictest10390-21latency_hist12:25:082
10476999375,12cyclictest300-21rs:main0
10490999241,43cyclictest0-21swapper/212:25:432
10490999241,43cyclictest0-21swapper/212:25:432
10490999238,49cyclictest0-21swapper/209:40:062
10490999137,46cyclictest0-21swapper/207:50:292
10490999135,49cyclictest0-21swapper/210:00:182
10490999135,49cyclictest0-21swapper/210:00:182
10480999152,33cyclictest352-21runrttasks11:00:201
10490999048,36cyclictest10931-21proc_pri11:30:392
10490999034,49cyclictest0-21swapper/211:05:202
1049099903,38cyclictest27014-21fschecks_time09:15:302
10490999026,55cyclictest23392-21systemctl09:10:062
10480999047,37cyclictest12399-21sh09:45:121
10480999047,37cyclictest12399-21sh09:45:121
10480999046,38cyclictest16217-21fschecks_time07:15:291
10476999064,20cyclictest19986-21ssh10:50:440
10490998938,44cyclictest0-21swapper/211:50:272
1049099893,31cyclictest21926-21wc10:55:102
10490998923,28cyclictest30475-21seq08:00:072
1048099892,6cyclictest0-21swapper/109:55:181
10476998961,20cyclictest12515-21sh08:45:060
1049099883,31cyclictest11910-21apt-get09:45:222
1049099883,31cyclictest11910-21apt-get09:45:222
1049099882,31cyclictest17953-21sh09:00:302
10480998840,40cyclictest0-21swapper/111:30:251
1048099883,6cyclictest0-21swapper/107:50:221
1048099883,31cyclictest10211-21cat09:40:441
1048099883,31cyclictest10211-21cat09:40:441
1048099882,30cyclictest21315-21diskmemload11:48:191
10476998868,14cyclictest11903-21idleruntime-cro09:45:060
10476998868,14cyclictest11903-21idleruntime-cro09:45:060
10490998738,42cyclictest0-21swapper/209:20:422
1049099873,29cyclictest25596-21/usr/sbin/munin11:00:342
1049099872,32cyclictest11538-21sed08:40:322
10490998719,32cyclictest17429-21sh09:53:172
10490998717,23cyclictest9366-21cat09:40:242
10490998717,23cyclictest9366-21cat09:40:242
10480998744,36cyclictest9737-21fschecks_count08:35:271
10480998739,38cyclictest1-21systemd08:10:381
10480998739,38cyclictest1-21systemd08:10:381
1048099873,7cyclictest0-21swapper/107:55:191
1048099873,38cyclictest27180-21awk10:10:061
1048099873,38cyclictest27180-21awk10:10:061
1048099873,21cyclictest352-21runrttasks08:30:451
10490998633,46cyclictest0-21swapper/210:31:062
1049099863,32cyclictest20963-21/usr/sbin/munin07:30:262
1049099863,31cyclictest19286-21/usr/sbin/munin11:45:242
1048099862,6cyclictest0-21swapper/107:20:191
1048099862,6cyclictest0-21swapper/107:20:191
1049099854,27cyclictest6305-21/usr/sbin/munin08:25:382
10490998540,39cyclictest2515-21sh11:15:442
1049099853,29cyclictest9813-21fschecks_time08:35:282
10490998528,46cyclictest0-21swapper/209:15:102
10490998525,7cyclictest0-21swapper/209:55:192
1049099852,36cyclictest15538-21ssh11:39:162
1049099852,36cyclictest15538-21ssh11:39:162
10490998523,54cyclictest0-21swapper/212:05:232
10490998522,8cyclictest0-21swapper/212:13:472
10490998522,8cyclictest0-21swapper/212:13:472
10480998550,27cyclictest0-21swapper/111:15:091
1048099853,36cyclictest18118-21ssh09:55:071
1048099852,57cyclictest25855-21apt-get07:45:251
1048099852,57cyclictest25855-21apt-get07:45:251
1048099852,33cyclictest352-21runrttasks09:12:401
10476998550,8cyclictest181rcu_preempt10:30:590
1049099844,28cyclictest7380-21latency_hist12:20:092
1049099844,27cyclictest3615-21latency_hist10:25:092
1049099843,31cyclictest10650-21/usr/sbin/munin07:00:292
1049099843,30cyclictest4723-21sh10:25:432
1049099843,29cyclictest12399-21taskset07:05:152
1049099843,28cyclictest24494-21/usr/sbin/munin10:05:362
1049099843,28cyclictest24494-21/usr/sbin/munin10:05:362
1049099842,34cyclictest2848-21sh08:15:062
1049099842,34cyclictest2848-21sh08:15:062
1048099843,38cyclictest12871-21/usr/sbin/munin07:05:301
1048099843,34cyclictest3650-21runrttasks10:25:071
10476998467,10cyclictest25957-21ntp_kernel_err11:55:340
1049099834,27cyclictest3096-21/usr/sbin/munin08:15:302
1049099834,27cyclictest3096-21/usr/sbin/munin08:15:302
1049099834,25cyclictest4309-21grep09:30:432
1049099834,25cyclictest4309-21grep09:30:432
10490998334,40cyclictest0-21swapper/211:25:292
1049099833,30cyclictest352-21runrttasks10:55:292
1049099833,30cyclictest352-21runrttasks10:55:292
1049099833,28cyclictest27367-21sendmail-mta11:58:122
1049099833,25cyclictest25360-21apt-get07:45:182
1049099833,25cyclictest25360-21apt-get07:45:182
10490998327,48cyclictest0-21swapper/211:15:092
10490998323,7cyclictest0-21swapper/207:15:072
1049099832,35cyclictest31230-21mailstats10:15:402
1049099832,35cyclictest31230-21mailstats10:15:402
1049099832,30cyclictest17534-21ssh10:47:102
1049099832,30cyclictest17534-21ssh10:47:102
10490998322,11cyclictest0-21swapper/211:40:452
10490998321,11cyclictest0-21swapper/208:05:372
10490998321,11cyclictest0-21swapper/208:05:372
10490998319,22cyclictest7085-21cut11:25:082
10490998318,23cyclictest32715-21sh09:25:232
10480998340,35cyclictest0-21swapper/110:25:291
10480998337,40cyclictest352-21runrttasks09:30:341
10480998337,40cyclictest352-21runrttasks09:30:341
1048099833,37cyclictest8296-21/usr/sbin/munin12:20:341
1048099832,6cyclictest0-21swapper/109:20:221
1048099832,45cyclictest22514-21apt-get11:50:271
1049099823,34cyclictest1-21systemd10:45:072
10490998220,23cyclictest19825-21cat07:25:392
10480998263,14cyclictest15857-21kworker/u17:1+events_unbound12:00:061
10480998238,37cyclictest0-21swapper/112:25:421
10480998238,37cyclictest0-21swapper/112:25:421
1048099823,37cyclictest11362-21/usr/sbin/munin07:00:411
1048099822,35cyclictest1422-21sh11:15:191
1049099813,30cyclictest23315-21grep07:35:422
10490998126,8cyclictest0-21swapper/210:13:132
10490998116,11cyclictest0-21swapper/207:22:312
10490998116,11cyclictest0-21swapper/207:22:312
10490998115,21cyclictest13368-21uname08:45:372
10480998160,15cyclictest13369-21sh10:40:331
1048099813,29cyclictest22390-21ntpq10:01:201
1048099813,29cyclictest22390-21ntpq10:01:201
1048099813,28cyclictest29135-21/usr/sbin/munin12:00:411
1048099813,28cyclictest11318-21/usr/sbin/munin08:40:251
1048099812,36cyclictest844-21/usr/sbin/munin08:05:441
1048099812,36cyclictest844-21/usr/sbin/munin08:05:441
1048099812,36cyclictest22147-21ssh10:55:201
1048099812,36cyclictest22147-21ssh10:55:201
1049099803,29cyclictest14397-21/usr/sbin/munin08:50:262
1049099803,28cyclictest32260-21latency_hist08:05:102
1049099803,28cyclictest23999-21/usr/sbin/munin07:40:262
1049099803,28cyclictest23999-21/usr/sbin/munin07:40:262
10480998036,37cyclictest0-21swapper/107:35:321
1048099803,37cyclictest7590-21grep11:25:291
1048099803,34cyclictest10605-21/usr/sbin/munin10:35:351
1048099803,31cyclictest5188-21/usr/sbin/munin08:20:331
1048099802,6cyclictest0-21swapper/109:05:201
1048099802,34cyclictest17425-21ssh09:00:081
1048099802,34cyclictest17425-21ssh09:00:081
10476998064,10cyclictest30247-21ssh10:15:080
1049099793,27cyclictest16917-21grep07:15:432
1048099793,30cyclictest14889-21/usr/sbin/munin08:50:321
1048099792,37cyclictest30145-21latency_hist10:15:081
1048099792,37cyclictest18576-21munin-plugin-st10:50:061
1048099792,37cyclictest18576-21munin-plugin-st10:50:061
1048099792,35cyclictest4679-21cat12:15:101
1048099792,35cyclictest352-21runrttasks12:09:441
1048099792,35cyclictest32707-21taskset09:25:221
1048099792,29cyclictest13394-21/usr/sbin/munin08:45:381
10476997964,9cyclictest31462-21ssh09:22:360
1047699794,43cyclictest4877-21sort10:25:440
10476997915,9cyclictest134202timerandwakeup09:45:570
10476997915,9cyclictest134202timerandwakeup09:45:570
1049099784,26cyclictest352-21runrttasks10:35:332
1048099784,36cyclictest4779-21ssh12:15:211
1048099783,36cyclictest8964-21ssh09:40:081
1048099783,35cyclictest4390-21ssh11:20:211
1048099783,29cyclictest30401-21latency_hist10:15:101
1048099783,29cyclictest30401-21latency_hist10:15:101
1048099783,26cyclictest6945-21/usr/sbin/munin08:25:391
1048099782,38cyclictest26736-21ssh09:15:221
1048099782,36cyclictest28509-21/usr/sbin/munin11:05:341
1048099782,31cyclictest19788-21sshd07:25:381
10476997863,9cyclictest368-21ssh09:25:250
1049099773,27cyclictest9294-21latency_hist08:35:092
1049099772,32cyclictest4724-21taskset08:20:192
1048099773,38cyclictest3558-21memory08:15:321
1048099773,38cyclictest3558-21memory08:15:321
1048099773,30cyclictest14955-21processes07:10:391
1048099772,30cyclictest20955-21/usr/sbin/munin07:30:251
10476997762,10cyclictest19985-21timerandwakeup07:25:410
10476997759,12cyclictest21068-21apt-key10:00:070
10476997758,13cyclictest1-21systemd08:10:070
10476997758,13cyclictest1-21systemd08:10:070
10476997756,15cyclictest12207-21latency_hist07:05:100
10476997726,25cyclictest29379-21unixbench_singl12:00:430
1048099763,30cyclictest352-21runrttasks12:10:221
1048099762,29cyclictest30854-21/usr/sbin/munin08:00:241
10476997661,11cyclictest10467-21cyclictest10:58:320
10476997661,11cyclictest10467-21cyclictest10:58:320
1047699757,58cyclictest352-21runrttasks12:12:050
1047699757,58cyclictest352-21runrttasks12:12:050
10476997557,12cyclictest4047-21unixbench_singl08:15:420
10476997557,12cyclictest4047-21unixbench_singl08:15:420
10476997556,13cyclictest300-21rs:main0
1047699753,36cyclictest15834-21latency_hist11:40:100
1047699753,36cyclictest15834-21latency_hist11:40:100
10476997457,12cyclictest19676-21snmpd11:47:050
10476997452,16cyclictest2374-21systemd-journal11:10:060
10476997358,10cyclictest10467-21cyclictest10:38:360
10476997355,10cyclictest16518-21ssh10:45:370
10476997355,10cyclictest16518-21ssh10:45:370
10476997353,14cyclictest26737-21ssh09:15:230
1047699725,57cyclictest21039-21apt-get10:00:220
1047699725,57cyclictest21039-21apt-get10:00:220
10476997255,12cyclictest10467-21cyclictest08:30:400
10476997255,11cyclictest31562-21ssh11:10:370
10476997254,11cyclictest7387-21cpuspeed11:25:230
10476997249,17cyclictest11828-21ssh12:25:560
10476997249,17cyclictest11828-21ssh12:25:560
10476997151,15cyclictest24673-21ssh10:05:250
10476997151,15cyclictest24673-21ssh10:05:250
10476997150,14cyclictest6042-21latency_hist09:35:090
10476997150,14cyclictest6042-21latency_hist09:35:090
1047699713,57cyclictest12894-21munin-plugin-st11:35:060
988727022,29sleep30-21swapper/306:55:533
10476997053,11cyclictest18285-21ssh11:43:040
10476997049,15cyclictest8026-21kworker/u19:1+events_unbound12:25:060
10476997037,25cyclictest0-21swapper/010:25:080
10476997037,24cyclictest23948-21cat07:40:100
1047699703,38cyclictest24996-21/usr/sbin/munin11:00:380
10476997030,30cyclictest6496-21grep08:25:280
10476996956,8cyclictest0-21swapper/011:20:420
1047699694,32cyclictest20415-21munin-run09:05:070
1047699693,56cyclictest32335-21sed12:05:430
1047699692,34cyclictest30704-21sort08:00:170
10476996849,13cyclictest21335-21sh09:05:400
10476996848,14cyclictest25626-21apt-key07:45:100
10476996848,14cyclictest25626-21apt-key07:45:100
1047699684,36cyclictest14332-21/usr/sbin/munin07:10:420
1047699683,36cyclictest5006-21chrt12:15:280
10476996751,10cyclictest3239-21ssh11:17:500
1047699672,33cyclictest6756-21needreboot09:35:340
1047699664,51cyclictest9542-21/usr/sbin/munin08:35:440
10476996544,15cyclictest12513-21kworker/u19:2+events_unbound08:50:060
10476996544,15cyclictest0-21swapper/007:25:090
10476996544,15cyclictest0-21swapper/007:25:090
1047699654,31cyclictest25836-21/usr/sbin/munin07:46:290
1047699654,31cyclictest25836-21/usr/sbin/munin07:46:290
1047699652,44cyclictest16013-21/usr/sbin/munin08:55:330
1047699652,44cyclictest16013-21/usr/sbin/munin08:55:330
1047699652,37cyclictest15188-21timerandwakeup08:50:400
1047699643,46cyclictest27717-21fschecks_time07:50:290
1047699643,45cyclictest1485-21/usr/sbin/munin08:10:440
1047699643,45cyclictest1485-21/usr/sbin/munin08:10:440
1047699643,44cyclictest352-21runrttasks08:00:010
1047699643,29cyclictest4701-21/usr/sbin/munin08:20:290
1047699633,44cyclictest17460-21sshd07:31:380
48012580,8sleep3451rcuc/311:20:323
1049599573,40cyclictest3931-21taskset10:25:183
1049599572,40cyclictest22613-21chrt11:50:413
1049599553,37cyclictest28558-21chrt12:00:273
1049599543,40cyclictest7247-21chrt10:30:433
1049599543,38cyclictest30846-21chrt09:20:523
1049599542,37cyclictest8906-21chrt09:40:063
1049599536,34cyclictest27837-21chrt09:15:493
1049599533,38cyclictest25355-21chrt11:00:293
1049599533,37cyclictest24001-21chrt09:10:303
1049599533,37cyclictest13668-21taskset10:40:403
1049599532,38cyclictest11875-21chrt11:32:113
1049599523,37cyclictest20248-21chrt09:57:543
1049599523,36cyclictest4833-21taskset08:20:233
1049599523,36cyclictest3089-21chrt12:11:143
1049599523,36cyclictest3089-21chrt12:11:143
1049599522,37cyclictest27969-21chrt10:10:353
1049599522,37cyclictest23865-21chrt10:57:413
1049599522,37cyclictest23865-21chrt10:57:413
1049599522,36cyclictest25434-21chrt11:55:203
1049599513,36cyclictest16568-21chrt07:15:393
1049599513,36cyclictest14358-21chrt09:48:043
1049599513,36cyclictest14358-21chrt09:48:043
1049599513,35cyclictest2437-21chrt09:28:513
1049599513,35cyclictest18829-21chrt11:44:383
1049599513,26cyclictest917-21kworker/3:1+events12:25:173
1049599513,26cyclictest917-21kworker/3:1+events12:25:173
1049599512,37cyclictest23911-21taskset07:40:093
1049599512,37cyclictest14887-21chrt07:10:373
1049599512,37cyclictest10388-21chrt12:25:083
1049599512,36cyclictest31482-21chrt12:05:263
1049599512,35cyclictest25085-21chrt10:05:363
1049599512,35cyclictest25085-21chrt10:05:363
292672500,7sleep30-21swapper/307:55:283
1049599504,31cyclictest12645-21chrt07:05:183
1049599503,35cyclictest20681-21taskset11:46:283
1049599503,34cyclictest7850-21chrt11:25:343
1049599502,36cyclictest3631-21taskset11:18:583
1049599502,36cyclictest15892-21chrt09:50:323
1049599502,35cyclictest19797-21chrt10:50:423
1049599502,34cyclictest21836-21chrt10:01:063
1049599502,34cyclictest21836-21chrt10:01:063
1049599493,34cyclictest31670-21chrt10:16:023
1049599493,34cyclictest31670-21chrt10:16:023
1049599493,34cyclictest31329-21chrt11:10:303
1049599493,34cyclictest17709-21chrt07:20:253
1049599493,34cyclictest17709-21chrt07:20:253
1049599493,34cyclictest14893-21chrt08:50:333
1049599493,33cyclictest28184-21chrt11:05:283
1049599493,33cyclictest27943-21chrt07:50:343
1049599492,34cyclictest4104-21taskset09:30:413
1049599492,34cyclictest4104-21taskset09:30:413
1049599492,33cyclictest12730-21chrt08:45:103
1049599484,31cyclictest9415-21taskset09:40:263
1049599484,31cyclictest9415-21taskset09:40:263
1049599484,31cyclictest3631-21taskset10:25:063
1049599483,34cyclictest17433-21chrt09:00:083
1049599483,34cyclictest17433-21chrt09:00:083
1049599483,32cyclictest9480-21chrt08:35:093
1049599483,32cyclictest31642-21chrt08:00:433
1049599482,34cyclictest5355-21chrt12:15:363
1049599473,32cyclictest25927-21chrt07:46:053
1049599473,32cyclictest25927-21chrt07:46:053
1049599473,28cyclictest21337-21taskset09:05:403
1049599472,33cyclictest14071-21chrt11:35:403
1049599472,33cyclictest14071-21chrt11:35:403
1049599472,32cyclictest21291-21chrt07:30:343
1049599463,32cyclictest13438-21chrt08:45:383
1049599463,29cyclictest3267-21taskset08:15:253
1049599463,29cyclictest3267-21taskset08:15:253
1049599463,29cyclictest17820-21chrt09:00:253
1049599463,29cyclictest16267-21taskset10:45:313
1049599463,29cyclictest16267-21taskset10:45:313
1049599453,33cyclictest25406-21chrt07:45:073
1049599453,33cyclictest25406-21chrt07:45:073
1049599453,30cyclictest1210-21taskset08:10:063
1049599453,30cyclictest1210-21taskset08:10:063
1049599452,31cyclictest11653-21chrt07:00:453
1049599433,27cyclictest20674-21chrt07:30:093
1049599423,26cyclictest10011-21taskset10:35:173
1049599413,29cyclictest10065-21taskset08:35:343
1049599403,27cyclictest2524-21taskset08:11:043
1049599403,27cyclictest2524-21taskset08:11:043
1049599393,26cyclictest6797-21taskset08:25:343
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional