You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-11 - 19:35
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Wed Mar 11, 2026 12:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2996022040,13sleep30-21swapper/307:05:323
2996022040,13sleep30-21swapper/307:05:323
299449912247,8cyclictest0-21swapper/010:55:420
299449911959,53cyclictest0-21swapper/011:35:440
299449911959,53cyclictest0-21swapper/011:35:440
299449911750,14cyclictest9736-21latency_hist07:40:300
299539911555,10cyclictest0-21swapper/109:35:501
299449911455,8cyclictest352-21runrttasks09:50:420
299449911455,8cyclictest352-21runrttasks09:50:420
299449910867,32cyclictest0-21swapper/009:40:300
28917210810,71sleep128948-21/usr/sbin/munin07:01:021
28917210810,71sleep128948-21/usr/sbin/munin07:01:021
299449910480,17cyclictest9915-21sh11:56:000
299449910479,19cyclictest298-21in:imuxsock11:50:310
29961999838,51cyclictest0-21swapper/207:15:292
29953999881,10cyclictest0-21swapper/107:20:311
29961999735,7cyclictest0-21swapper/211:20:492
29961999645,42cyclictest0-21swapper/208:05:302
29961999645,42cyclictest0-21swapper/208:05:302
29944999679,12cyclictest29931-21cyclictest11:11:070
29961999539,50cyclictest30953-21latency_hist08:45:302
29961999536,13cyclictest0-21swapper/212:15:502
2996199952,53cyclictest23888-21ssh11:25:472
29944999569,18cyclictest0-21swapper/008:41:010
29944999472,12cyclictest0-21swapper/007:45:510
292592949,59sleep029350-21cat07:01:140
292592949,59sleep029350-21cat07:01:140
29961999330,11cyclictest0-21swapper/208:55:592
29953999377,11cyclictest0-21swapper/109:05:451
29953999377,11cyclictest0-21swapper/109:05:451
29953999367,20cyclictest4905-21diskmemload11:45:271
29961999240,45cyclictest25762-21latency_hist09:40:302
29961999232,12cyclictest0-21swapper/209:05:492
29961999232,12cyclictest0-21swapper/209:05:492
29961999231,9cyclictest0-21swapper/209:35:312
2996199922,32cyclictest8768-21rm10:05:382
2996199922,32cyclictest8768-21rm10:05:382
29961999223,14cyclictest0-21swapper/207:22:202
29944999269,14cyclictest0-21swapper/007:11:040
29961999133,11cyclictest0-21swapper/209:00:522
29961999131,7cyclictest0-21swapper/210:22:222
29961999127,7cyclictest0-21swapper/210:15:502
29961999127,7cyclictest0-21swapper/209:26:012
29953999177,8cyclictest0-21swapper/107:25:301
29944999169,11cyclictest0-21swapper/009:55:550
29944999169,11cyclictest0-21swapper/009:55:550
29961999039,43cyclictest0-21swapper/211:05:492
29961999032,6cyclictest0-21swapper/211:10:462
29961999030,7cyclictest0-21swapper/209:21:002
29961998924,22cyclictest15137-21cpuspeed12:05:432
29944998968,15cyclictest0-21swapper/007:15:530
29944998968,10cyclictest0-21swapper/008:30:440
29944998962,19cyclictest7743-21latency_hist07:35:320
29961998835,8cyclictest0-21swapper/209:10:582
29961998834,8cyclictest0-21swapper/210:36:002
29961998834,11cyclictest0-21swapper/209:46:452
29961998833,13cyclictest3691-21switchtime09:56:082
29961998833,13cyclictest3691-21switchtime09:56:082
2996199883,25cyclictest28146-21fschecks_count08:35:492
29961998825,8cyclictest0-21swapper/212:25:592
29961998822,17cyclictest277-21dbus-daemon09:45:282
29953998867,12cyclictest0-21swapper/107:11:021
29944998872,8cyclictest0-21swapper/012:05:300
29961998734,46cyclictest0-21swapper/211:00:302
2996199873,29cyclictest19791-21fschecks_time08:10:492
2996199873,29cyclictest19791-21fschecks_time08:10:492
29961998732,8cyclictest0-21swapper/211:45:502
29961998731,7cyclictest0-21swapper/208:45:482
29961998731,7cyclictest0-21swapper/208:45:482
29961998731,49cyclictest8028-21apt-key07:35:322
29961998728,12cyclictest0-21swapper/207:50:512
29961998727,9cyclictest0-21swapper/207:45:502
29961998727,13cyclictest0-21swapper/208:25:302
29961998723,11cyclictest0-21swapper/210:50:402
29944998769,8cyclictest0-21swapper/008:15:310
29944998769,8cyclictest0-21swapper/008:15:310
29944998752,7cyclictest181rcu_preempt07:30:310
2996199863,31cyclictest6473-21ssh10:01:002
29961998628,7cyclictest0-21swapper/208:27:042
29961998626,7cyclictest0-21swapper/210:25:542
29961998625,9cyclictest0-21swapper/208:05:512
29961998625,8cyclictest0-21swapper/212:21:142
29953998656,21cyclictest6127-21modprobe07:30:281
29944998670,8cyclictest0-21swapper/009:25:450
2996199854,35cyclictest1755-21latency_hist08:55:292
2996199853,29cyclictest32400-21cstates09:50:442
2996199853,29cyclictest32400-21cstates09:50:442
2996199853,27cyclictest2579-21modprobe10:50:272
29961998526,7cyclictest0-21swapper/211:56:282
29953998567,11cyclictest0-21swapper/111:57:161
2996199843,30cyclictest11204-21sh09:15:372
2996199843,28cyclictest23510-21/usr/sbin/munin10:31:022
2996199843,28cyclictest23510-21/usr/sbin/munin10:31:022
2996199843,24cyclictest29916-21latency10:40:532
29961998429,9cyclictest0-21swapper/212:35:262
29961998429,9cyclictest0-21swapper/212:35:262
2996199842,30cyclictest30780-21grep11:36:052
2996199842,30cyclictest30780-21grep11:36:052
29944998466,9cyclictest0-21swapper/008:40:270
29944998464,11cyclictest0-21swapper/010:41:010
29953998367,9cyclictest0-21swapper/112:10:481
29953998367,9cyclictest0-21swapper/112:10:481
29953998362,15cyclictest5539-21sh10:55:281
29944998355,22cyclictest0-21swapper/012:12:260
29944998355,22cyclictest0-21swapper/012:12:260
231702830,6sleep30-21swapper/310:30:223
2996199823,30cyclictest30224-21cstates07:05:452
2996199823,30cyclictest30224-21cstates07:05:452
2996199823,24cyclictest27412-21chrt11:30:592
29961998219,16cyclictest4905-21diskmemload11:16:442
29953998268,8cyclictest0-21swapper/111:10:271
29953998265,11cyclictest0-21swapper/108:25:301
29953998262,9cyclictest0-21swapper/112:25:411
29944998268,8cyclictest0-21swapper/008:45:470
29944998268,8cyclictest0-21swapper/008:45:470
29944998260,12cyclictest0-21swapper/011:26:350
29961998158,16cyclictest12559-21/usr/sbin/munin10:11:012
2996199813,25cyclictest1326-21/usr/sbin/munin07:16:012
29961998114,20cyclictest1376-21sh11:41:082
2996199803,23cyclictest352-21runrttasks11:01:172
2996199802,25cyclictest6849-21ps11:50:592
29961998022,15cyclictest0-21swapper/207:40:512
2996199793,24cyclictest20657-21latency_hist12:15:312
2996199793,21cyclictest26498-21fschecks_count08:30:492
29953997965,8cyclictest0-21swapper/108:56:011
29953997960,13cyclictest23614-21idleruntime-cro12:20:271
29953997957,11cyclictest0-21swapper/110:35:311
29953997957,11cyclictest0-21swapper/110:35:311
29944997966,7cyclictest0-21swapper/010:36:010
29944997957,12cyclictest0-21swapper/010:35:310
29944997957,12cyclictest0-21swapper/010:35:310
29944997954,13cyclictest15-21ksoftirqd/010:11:340
29944997950,12cyclictest277-21dbus-daemon07:55:280
29944997940,27cyclictest0-21swapper/010:20:310
2996199783,27cyclictest21930-21switchtime08:16:012
2996199783,27cyclictest21930-21switchtime08:16:012
2996199783,27cyclictest17967-21/usr/sbin/munin12:11:002
2996199783,27cyclictest12606-21taskset12:00:542
29953997859,13cyclictest20969-21threads09:31:011
29953997849,21cyclictest58-21kcompactd008:12:151
29953997849,21cyclictest58-21kcompactd008:12:151
2996199772,30cyclictest29802-21latency_hist07:05:322
2996199772,30cyclictest29802-21latency_hist07:05:322
2996199772,26cyclictest6230-21latency_hist07:30:302
29953997762,8cyclictest0-21swapper/109:41:041
29953997757,10cyclictest0-21swapper/109:28:201
29944997761,9cyclictest0-21swapper/009:05:510
29944997761,9cyclictest0-21swapper/009:05:510
29944997757,11cyclictest0-21swapper/010:46:030
29944997754,8cyclictest181rcu_preempt12:15:450
29944997749,19cyclictest32692-21latency_hist12:35:310
29944997749,19cyclictest32692-21latency_hist12:35:310
29944997743,15cyclictest15044-21ssh09:21:030
2996199763,24cyclictest8535-21fschecks_time07:36:102
29953997662,8cyclictest0-21swapper/112:10:291
29953997661,9cyclictest0-21swapper/109:56:001
29953997661,9cyclictest0-21swapper/109:56:001
29953997656,10cyclictest0-21swapper/108:35:581
29944997660,10cyclictest2862-21sh11:45:250
29944997642,25cyclictest18201-21latency11:15:530
2996199753,26cyclictest15580-21wc07:56:032
2996199753,26cyclictest15580-21wc07:56:032
29953997560,9cyclictest30888-21sed12:31:041
29953997560,9cyclictest30888-21sed12:31:041
29953997559,10cyclictest27677-21kworker/u17:3-rpciod10:15:541
29953997557,9cyclictest0-21swapper/109:52:491
29953997557,9cyclictest0-21swapper/109:52:491
29953997555,10cyclictest0-21swapper/110:49:041
29953997430,9cyclictest181rcu_preempt11:25:301
29944997460,8cyclictest0-21swapper/008:00:520
29944997460,8cyclictest0-21swapper/008:00:520
29944997452,16cyclictest29483-21sh12:30:260
29944997447,7cyclictest181rcu_preempt07:22:110
29944997441,26cyclictest0-21swapper/011:00:540
29953997359,8cyclictest0-21swapper/111:01:061
29953997354,11cyclictest277-21dbus-daemon09:15:281
29944997354,13cyclictest300-21rs:main0
29944997348,19cyclictest24004-21cpuspeed12:20:430
29965997257,9cyclictest176612sleep308:05:273
29965997257,9cyclictest176612sleep308:05:273
29953997256,10cyclictest20579-21ssh10:25:371
29953997251,15cyclictest11472-21/usr/sbin/munin07:45:491
29953997250,16cyclictest6311-21sh10:00:541
29944997256,10cyclictest10380-21ssh10:07:320
29944997256,10cyclictest10380-21ssh10:07:320
29944997254,9cyclictest0-21swapper/011:08:180
29944997254,12cyclictest5834-21cpu10:00:440
29944997254,12cyclictest29423-21ssh11:35:280
29953997152,14cyclictest16430-21sh11:12:481
29953997141,21cyclictest30322-21cut07:05:491
29953997141,21cyclictest30322-21cut07:05:491
29944997152,14cyclictest277-21dbus-daemon09:50:290
29944997143,19cyclictest0-21swapper/008:06:030
29953997055,8cyclictest0-21swapper/109:16:041
2995399702,37cyclictest7364-21grep07:31:051
29944997050,14cyclictest23463-21latency_hist11:25:300
29944997044,19cyclictest0-21swapper/008:20:370
29953996956,7cyclictest0-21swapper/111:35:581
29953996956,7cyclictest0-21swapper/111:35:581
29953996954,9cyclictest0-21swapper/111:26:341
29953996951,13cyclictest277-21dbus-daemon12:05:281
29953996947,13cyclictest8216-21kworker/u17:2-xprtiod09:20:571
29953996937,10cyclictest181rcu_preempt10:10:411
29944996953,10cyclictest15669-21ssh12:05:570
29944996950,13cyclictest20716-21ntp_offset09:30:550
29944996949,9cyclictest0-21swapper/009:10:520
29944996949,14cyclictest20267-21idleruntime-cro10:25:270
29953996849,13cyclictest9550-21sh10:06:011
29953996849,13cyclictest9550-21sh10:06:011
29953996847,15cyclictest6445-21awk10:55:541
29953996837,22cyclictest30872-21cron08:45:271
29944996855,9cyclictest170-21jbd2/mmcblk2p2-807:41:050
29944996854,7cyclictest0-21swapper/010:50:510
29944996847,16cyclictest16086-21kworker/u18:0+events_unbound08:20:270
29944996847,16cyclictest16086-21kworker/u18:0+events_unbound08:20:270
29953996752,9cyclictest0-21swapper/109:45:371
29953996752,8cyclictest0-21swapper/110:45:311
29953996737,10cyclictest58-21kcompactd011:46:011
29944996749,13cyclictest20847-21fschecks_time10:25:480
29944996746,13cyclictest0-21swapper/008:50:540
29944996729,7cyclictest181rcu_preempt09:42:570
29953996652,10cyclictest29931-21cyclictest07:50:461
29953996651,9cyclictest24778-21ssh12:21:021
29953996647,13cyclictest9055-21threads07:36:231
29953996645,15cyclictest3617-21cpuspeed09:00:461
29953996638,8cyclictest181rcu_preempt08:50:291
29953996638,8cyclictest181rcu_preempt08:50:291
29953996544,15cyclictest298-21in:imuxsock08:20:251
29953996544,15cyclictest298-21in:imuxsock08:20:251
29953996526,14cyclictest0-21swapper/110:22:171
29944996546,13cyclictest352-21runrttasks07:55:440
29944996546,13cyclictest352-21runrttasks07:55:440
29944996544,15cyclictest3397-21latency_hist09:00:300
29953996447,13cyclictest11259-21kworker/u19:2+events_unbound08:55:271
29944996449,8cyclictest0-21swapper/009:01:020
29944996435,20cyclictest5826-21modprobe11:50:270
29953996349,9cyclictest31-21ksoftirqd/111:50:401
29953996348,10cyclictest29931-21cyclictest11:35:311
29944996351,8cyclictest31507-21kworker/1:207:10:290
29944996351,8cyclictest31507-21kworker/1:207:10:290
29953996248,9cyclictest0-21swapper/108:35:191
29953996247,9cyclictest0-21swapper/111:16:021
29953996245,12cyclictest14706-21/usr/sbin/munin07:55:561
29953996245,12cyclictest14706-21/usr/sbin/munin07:55:561
29944996148,7cyclictest0-21swapper/008:27:160
29953996046,10cyclictest29931-21cyclictest08:06:041
29953995937,16cyclictest26718-21fschecks_count10:35:481
29953995930,22cyclictest17289-21grep08:01:051
29953995930,22cyclictest17289-21grep08:01:051
180862590,5sleep30-21swapper/311:15:513
2995399573,31cyclictest26039-21latency_hist08:30:301
29953995635,14cyclictest300-21rs:main1
2996599545,32cyclictest27902-21taskset09:43:063
29965995421,21cyclictest6579-21chrt10:01:023
2996599524,36cyclictest11805-21chrt11:05:423
2996599524,33cyclictest12815-21taskset07:50:273
2996599519,28cyclictest14119-21taskset09:20:323
2996599513,34cyclictest29925-21chrt12:30:433
2996599513,34cyclictest29925-21chrt12:30:433
2996599504,34cyclictest17988-21taskset10:20:443
2996599503,34cyclictest2912-21taskset11:45:273
2996599503,34cyclictest20680-21taskset11:20:423
2996599503,33cyclictest23131-21taskset09:35:403
2996599494,33cyclictest8661-21taskset11:00:313
2996599494,31cyclictest21396-21taskset12:15:523
2996599494,31cyclictest17598-21chrt11:15:313
2996599493,36cyclictest11380-21taskset11:59:213
2996599493,33cyclictest13152-21chrt12:01:043
2996599492,35cyclictest8187-21chrt09:10:393
2996599484,32cyclictest5947-21chrt11:50:303
2996599483,33cyclictest31391-21taskset08:45:483
2996599483,33cyclictest31391-21taskset08:45:483
2996599483,33cyclictest2314-21taskset07:16:053
2996599483,33cyclictest19708-21taskset12:12:483
2996599483,33cyclictest19708-21taskset12:12:483
2996599483,32cyclictest5430-21chrt09:05:483
2996599483,32cyclictest5430-21chrt09:05:483
2996599482,34cyclictest31807-21chrt07:10:343
2996599482,34cyclictest20074-21chrt09:30:343
2996599475,30cyclictest8893-21taskset10:05:443
2996599475,30cyclictest8893-21taskset10:05:443
2996599474,31cyclictest9915-21chrt11:01:083
2996599474,31cyclictest29558-21chrt09:46:223
2996599474,31cyclictest2851-21taskset10:50:333
2996599474,31cyclictest27872-21chrt08:35:313
2996599474,31cyclictest1858-21taskset09:53:443
2996599474,31cyclictest1858-21taskset09:53:443
2996599474,31cyclictest15513-21chrt07:56:023
2996599474,31cyclictest15513-21chrt07:56:023
2996599474,30cyclictest5014-21chrt07:25:493
2996599473,34cyclictest16942-21taskset12:08:223
2996599473,32cyclictest11741-21chrt10:10:393
2996599473,32cyclictest10141-21chrt07:40:473
2996599473,31cyclictest3627-21chrt09:00:463
2996599473,31cyclictest26737-21taskset11:30:353
2996599473,30cyclictest851-21taskset08:50:583
2996599473,30cyclictest13097-21taskset07:50:403
2996599472,35cyclictest24050-21taskset10:30:553
2996599472,35cyclictest24050-21taskset10:30:553
2996599465,29cyclictest6218-21chrt11:50:423
2996599464,30cyclictest29529-21chrt08:40:373
2996599464,30cyclictest26692-21taskset11:30:313
2996599464,30cyclictest24474-21chrt08:25:313
2996599464,28cyclictest8275-21chrt07:35:413
2996599463,31cyclictest27125-21chrt10:35:583
2996599463,31cyclictest26868-21chrt12:25:373
2996599463,31cyclictest23924-21taskset12:20:383
2996599463,30cyclictest7625-21taskset07:34:113
2996599463,30cyclictest32370-21taskset10:45:353
2996599463,30cyclictest30132-21taskset07:05:443
2996599463,30cyclictest30132-21taskset07:05:443
2996599462,30cyclictest3031-21taskset09:55:513
2996599462,30cyclictest3031-21taskset09:55:513
2996599455,30cyclictest18796-21taskset09:27:383
2996599454,29cyclictest20241-21chrt08:11:013
2996599454,29cyclictest20241-21chrt08:11:013
2996599453,32cyclictest18746-21taskset08:06:033
2996599453,31cyclictest12067-21taskset09:16:023
2996599453,30cyclictest3392-21chrt09:00:303
2996599453,30cyclictest30986-21taskset11:36:273
2996599453,30cyclictest30986-21taskset11:36:273
2996599453,29cyclictest17817-21taskset10:20:323
2996599444,30cyclictest29570-21taskset10:40:443
2996599442,29cyclictest3159-21taskset07:20:343
2996599433,30cyclictest24910-21chrt08:27:013
2996599433,28cyclictest21197-21taskset08:15:383
2996599433,28cyclictest21197-21taskset08:15:383
2996599424,28cyclictest28903-21taskset08:36:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional