You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-14 - 01:06
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Mon Jul 13, 2026 12:44:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32133215316,99sleep032162-21munin-run06:57:060
323009911854,37cyclictest32271-21cyclictest10:57:262
322809911655,53cyclictest0-21swapper/008:02:590
32280991112,20cyclictest31610-21apt-get08:32:190
322809911051,53cyclictest13795-21idleruntime-cro11:52:060
322939910870,32cyclictest0-21swapper/108:57:461
322809910737,62cyclictest20993-21grep07:57:430
31175210711,65sleep231264-21/usr/sbin/munin06:52:402
323009910562,36cyclictest3404-21latency_hist07:07:112
323009910562,36cyclictest3404-21latency_hist07:07:112
2936921050,6sleep30-21swapper/310:28:033
2936921050,6sleep30-21swapper/310:28:033
32280991043,23cyclictest20275-21/usr/sbin/munin11:08:230
323009910256,39cyclictest298-21in:imuxsock07:27:082
323009910256,39cyclictest298-21in:imuxsock07:27:082
32280991022,21cyclictest29781-21/usr/sbin/munin10:28:150
32280991022,21cyclictest29781-21/usr/sbin/munin10:28:150
322809910150,45cyclictest19795-21idleruntime-cro07:57:060
32280991014,43cyclictest5089-21basename09:47:330
32280991014,43cyclictest5089-21basename09:47:330
322939910060,33cyclictest0-21swapper/109:52:321
32280991003,24cyclictest14491-21cat10:57:280
32280999931,60cyclictest12969-21/usr/sbin/munin09:07:090
32280999926,52cyclictest0-21swapper/009:22:160
32280999922,23cyclictest4785-21sort07:08:220
32280999820,8cyclictest0-21swapper/010:39:200
32280999820,8cyclictest0-21swapper/010:39:200
32280999819,23cyclictest26399-21runrttasks10:22:390
32280999818,24cyclictest23042-21seq11:12:170
32293999752,35cyclictest0-21swapper/108:37:101
3228099973,40cyclictest4389-21latency_hist09:47:100
3228099973,22cyclictest17195-21cpuspeed10:07:590
3228099973,22cyclictest17195-21cpuspeed10:07:590
3230099963,45cyclictest8241-21ssh11:42:232
32293999657,31cyclictest0-21swapper/109:52:091
32293999657,31cyclictest0-21swapper/109:52:091
3228099964,25cyclictest26767-21taskset08:17:180
3228099963,27cyclictest28905-21apt-get11:22:200
32300999553,33cyclictest0-21swapper/211:57:352
32293999550,38cyclictest5554-21cpu07:12:251
3229399953,49cyclictest13601-21tune2fs09:07:301
3229399953,49cyclictest13601-21tune2fs09:07:301
3228099954,25cyclictest14298-21cstates11:52:280
32280999539,48cyclictest0-21swapper/007:07:090
32280999539,48cyclictest0-21swapper/007:07:090
32280999538,50cyclictest31755-21sh10:32:190
3228099953,23cyclictest16574-21runrttasks09:12:290
3228099953,21cyclictest32070-21apt-get12:22:560
3228099944,24cyclictest14449-21mailstats10:02:430
32280999433,53cyclictest0-21swapper/008:22:390
32280999433,53cyclictest0-21swapper/008:22:390
32293999351,36cyclictest3135-21threads08:42:431
3228099934,31cyclictest17398-21/usr/sbin/munin07:47:400
3228099934,26cyclictest1586-21munin-node12:02:170
3228099934,26cyclictest1586-21munin-node12:02:170
32280999336,50cyclictest0-21swapper/007:27:430
3228099933,31cyclictest11315-21cat10:52:270
32293999253,31cyclictest0-21swapper/110:52:271
32280999229,54cyclictest0-21swapper/007:32:300
32280999211,25cyclictest8102-21if_eth009:52:320
32300999158,24cyclictest23855-21cat12:07:432
3230099913,26cyclictest352-21runrttasks11:17:502
3228099914,28cyclictest8925-21fschecks_count07:22:280
3228099914,28cyclictest8925-21fschecks_count07:22:280
3228099914,26cyclictest25657-21uname09:27:340
3228099914,26cyclictest25657-21uname09:27:340
3228099914,25cyclictest14505-21grep07:37:450
3228099913,26cyclictest2386-21runrttasks11:32:240
3228099913,25cyclictest13280-21/usr/sbin/munin09:07:240
3228099913,25cyclictest13280-21/usr/sbin/munin09:07:240
3228099913,22cyclictest31168-21apt-get09:37:170
32280999126,56cyclictest0-21swapper/011:17:380
32280999123,7cyclictest0-21swapper/009:19:070
32280999123,7cyclictest0-21swapper/009:19:070
3228099912,21cyclictest19187-21ssh12:00:480
32280999114,22cyclictest18760-21sh11:04:240
32280999111,26cyclictest8181-21/usr/sbin/munin08:57:450
32293999053,29cyclictest0-21swapper/111:02:051
3228099904,24cyclictest0-21swapper/009:37:070
32280999037,47cyclictest8517-21ssh10:47:310
3228099903,27cyclictest5196-21runrttasks10:42:230
3228099902,24cyclictest32708-21/usr/sbin/munin11:27:430
32280999016,24cyclictest6758-21rm11:38:500
32280999015,22cyclictest11801-21who09:57:460
32280999013,22cyclictest26267-21uname12:12:310
32300998945,37cyclictest0-21swapper/209:27:362
32300998945,37cyclictest0-21swapper/209:27:362
32293998951,30cyclictest0-21swapper/110:17:231
3228099893,21cyclictest1360-21/usr/sbin/munin07:02:080
3228099892,24cyclictest6598-21grep08:52:440
32280998914,22cyclictest31470-21apt-key12:22:080
32280998911,9cyclictest0-21swapper/012:07:270
32300998847,35cyclictest6981-21diskmemload09:59:392
3230099883,49cyclictest28801-21runrttasks12:17:202
32293998848,34cyclictest0-21swapper/110:37:431
32293998848,34cyclictest0-21swapper/110:37:431
32280998872,8cyclictest0-21swapper/010:17:430
3228099883,27cyclictest23726-21grep08:07:280
3228099883,23cyclictest20431-21/usr/sbin/munin10:12:370
32280998830,52cyclictest8195-21/usr/sbin/munin11:42:180
3228099882,29cyclictest352-21runrttasks07:12:250
32300998746,32cyclictest0-21swapper/207:12:452
3230099872,35cyclictest352-21runrttasks12:23:342
3230099872,28cyclictest6981-21diskmemload09:21:522
3230099872,28cyclictest6981-21diskmemload09:21:522
3230099872,26cyclictest15338-21sh10:04:192
32293998743,38cyclictest10737-21sh09:02:351
32293998739,42cyclictest397-21processes12:23:521
3228099874,27cyclictest4976-21unixbench_singl08:47:440
3228099874,27cyclictest4976-21unixbench_singl08:47:440
3228099874,27cyclictest16564-21modprobe07:47:070
3228099873,27cyclictest3330-21grep08:42:450
3228099873,26cyclictest25411-21grep08:12:290
3228099872,24cyclictest8542-21runrttasks07:22:090
32300998643,36cyclictest0-21swapper/211:34:352
32293998645,35cyclictest352-21runrttasks12:00:441
32293998633,45cyclictest0-21swapper/111:08:241
3228099863,24cyclictest1410-21mailstats08:37:410
32300998545,33cyclictest300-21rs:main2
32300998545,33cyclictest0-21swapper/211:27:292
32300998545,33cyclictest0-21swapper/210:32:432
32300998542,37cyclictest21425-21apt-key08:02:082
3230099853,37cyclictest31590-21ssh11:27:072
32293998564,14cyclictest32271-21cyclictest11:22:271
32293998563,16cyclictest6981-21diskmemload12:17:351
32293998536,42cyclictest26496-21sh08:17:061
32293998520,55cyclictest22430-21cat09:22:271
3228099853,24cyclictest31559-21latency_hist08:32:100
32300998446,33cyclictest32271-21cyclictest10:07:582
32300998446,33cyclictest32271-21cyclictest10:07:582
32300998446,28cyclictest0-21swapper/208:57:262
32300998442,36cyclictest6605-21uptime08:52:442
32300998442,35cyclictest0-21swapper/212:12:222
3230099842,36cyclictest13781-21cron11:52:062
32293998441,36cyclictest31189-21sh09:37:201
32293998439,38cyclictest23192-21cstates11:12:241
32293998419,28cyclictest24881-21modprobe08:12:061
32300998346,29cyclictest0-21swapper/209:17:062
32300998345,32cyclictest3187-21timerwakeupswit10:37:442
32300998345,32cyclictest3187-21timerwakeupswit10:37:442
32300998344,32cyclictest0-21swapper/208:32:442
3230099833,34cyclictest28449-21ssh10:27:072
3230099833,31cyclictest23494-21/usr/sbin/munin10:17:402
3230099833,30cyclictest14520-21/usr/sbin/munin11:52:352
3230099832,35cyclictest15737-21ntp_states07:42:382
32293998364,12cyclictest16250-21/usr/sbin/munin09:12:431
32293998341,35cyclictest0-21swapper/109:57:421
3230099823,37cyclictest28351-21apt-get10:27:192
3230099823,37cyclictest28351-21apt-get10:27:192
3230099823,35cyclictest2661-21/usr/sbin/munin08:42:312
3230099823,24cyclictest22387-21/usr/sbin/munin08:02:492
32300998227,43cyclictest0-21swapper/207:02:102
3230099822,34cyclictest31419-21fschecks_count09:37:282
3230099822,34cyclictest28816-21memory08:22:332
3230099822,34cyclictest28816-21memory08:22:332
32293998266,10cyclictest12088-21cstates07:32:251
32293998231,44cyclictest0-21swapper/111:42:431
32300998160,16cyclictest32271-21cyclictest10:12:252
3230099814,14cyclictest30000-21apt-get08:27:212
32300998141,31cyclictest6644-21sh09:50:022
32300998141,31cyclictest6644-21sh09:50:022
32300998137,33cyclictest0-21swapper/207:52:242
3230099813,34cyclictest16917-21cpuspeed07:47:252
3230099813,33cyclictest6028-21grep11:37:432
3230099813,30cyclictest8596-21timerandwakeup09:52:452
3230099813,27cyclictest20588-21ntp_states12:02:392
3230099813,27cyclictest20588-21ntp_states12:02:392
3230099812,37cyclictest2023-21sort09:42:302
3230099812,36cyclictest10318-21ssh09:02:242
3230099812,35cyclictest1128-21kernelversion08:37:332
32293998151,26cyclictest32271-21cyclictest10:12:441
3229399813,27cyclictest17199-21kernelversion07:47:331
3229399813,23cyclictest28409-21gpgv10:27:061
32293998128,42cyclictest0-21swapper/110:47:241
32293998118,24cyclictest24381-21diskmemload12:08:461
32300998062,12cyclictest297-21systemd-logind07:12:082
32300998059,14cyclictest31038-21latency_hist09:37:092
3230099803,33cyclictest8671-21sed07:22:102
3230099803,33cyclictest27446-21/usr/sbin/munin08:17:412
3230099802,35cyclictest25332-21fschecks_count08:12:282
3230099802,34cyclictest8887-21mailstats10:47:412
3230099802,32cyclictest21321-21taskset11:08:442
3230099802,26cyclictest10996-21/usr/sbin/munin07:27:392
32293998054,16cyclictest0-21swapper/108:22:421
32293998054,16cyclictest0-21swapper/108:22:421
32293998042,31cyclictest28883-21sh10:27:121
32293998042,31cyclictest28883-21sh10:27:121
3229399803,25cyclictest13768-21cat07:37:291
3229399803,24cyclictest7934-21unin-run11:42:071
32293998030,44cyclictest0-21swapper/110:08:111
32293998030,44cyclictest0-21swapper/110:08:111
32293998029,44cyclictest0-21swapper/112:12:281
3229399802,27cyclictest19495-21fschecks_count09:17:281
3229399802,27cyclictest19495-21fschecks_count09:17:281
3230099793,34cyclictest11814-21/usr/sbin/munin10:52:402
3230099793,32cyclictest23621-21ntp_kernel_err11:12:352
3230099793,25cyclictest24232-21/usr/sbin/munin08:07:412
3230099792,35cyclictest5358-21idleruntime-cro08:52:062
3230099792,35cyclictest5358-21idleruntime-cro08:52:062
3230099792,34cyclictest13243-21date09:07:112
3230099792,34cyclictest13243-21date09:07:112
3230099792,27cyclictest13352-21modprobe07:37:062
32293997957,12cyclictest0-21swapper/107:02:101
32293997934,40cyclictest0-21swapper/111:17:311
32293997930,41cyclictest0-21swapper/111:02:331
32293997929,42cyclictest0-21swapper/110:42:201
32293997918,26cyclictest16369-21seq07:45:021
3230099783,35cyclictest23088-21/usr/sbin/munin09:22:412
32293997839,32cyclictest0-21swapper/108:27:161
3229399783,38cyclictest20591-21ssh12:02:381
3229399783,38cyclictest20591-21ssh12:02:381
3229399783,26cyclictest3885-21apt-key07:07:111
3229399783,26cyclictest21512-21apt-key08:02:091
3229399783,11cyclictest14133-21apt-get11:52:231
3229399782,31cyclictest9434-21runrttasks07:22:411
3229399782,31cyclictest9434-21runrttasks07:22:411
3229399782,28cyclictest22885-21grep08:02:591
32300997737,33cyclictest0-21swapper/210:42:242
32293997758,13cyclictest544-21cron09:37:061
32293997733,40cyclictest32271-21cyclictest11:27:241
3229399773,28cyclictest25855-21ntp_states09:27:401
3229399773,28cyclictest25855-21ntp_states09:27:401
3229399773,24cyclictest1825-21/usr/sbin/munin09:42:241
32293997726,44cyclictest0-21swapper/108:17:281
3229399772,30cyclictest3979-21taskset07:07:481
32293997656,10cyclictest0-21swapper/108:47:281
32293997656,10cyclictest0-21swapper/108:47:281
3229399764,26cyclictest11249-21cpu11:47:221
3229399763,24cyclictest16382-21http10:07:061
3229399762,26cyclictest31960-21ssh10:32:291
3229399762,25cyclictest5727-21ls08:52:241
3230099753,33cyclictest13863-21fschecks_time07:37:312
3229399753,28cyclictest10658-21fschecks_time07:27:291
3229399753,22cyclictest2306-21latency_hist08:42:101
3229399752,24cyclictest2483-21cstates11:32:251
3229399752,24cyclictest1906-21munin-node07:02:171
3229399752,22cyclictest19834-21latency_hist07:57:081
3229399752,21cyclictest32296-21latency_hist06:57:101
3229399723,23cyclictest8500-21modprobe07:22:071
3230699673,50cyclictest19033-21taskset12:00:203
3230699663,50cyclictest760-21chrt12:23:573
3230699663,50cyclictest12098-21chrt07:32:253
3230699663,49cyclictest22293-21taskset10:16:413
3230699663,48cyclictest3581-21taskset08:45:333
3230699662,50cyclictest25854-21chrt12:12:163
3230699653,48cyclictest7240-21taskset08:57:113
3230699653,48cyclictest25750-21chrt10:22:213
3230699653,47cyclictest28485-21chrt11:21:483
3230699653,47cyclictest14126-21taskset10:57:193
3230699652,50cyclictest10113-21chrt09:56:263
3230699652,49cyclictest8163-21taskset07:18:033
3230699652,49cyclictest21892-21taskset12:05:073
3230699652,49cyclictest21892-21taskset12:05:073
3230699643,49cyclictest25167-21taskset08:12:233
3230699643,49cyclictest17397-21chrt07:47:403
3230699643,47cyclictest2197-21chrt07:02:273
3230699643,47cyclictest2197-21chrt07:02:273
3230699642,49cyclictest13753-21taskset07:37:273
3230699633,48cyclictest2379-21taskset09:42:403
3230699633,48cyclictest13699-21taskset10:02:213
3230699633,47cyclictest4170-21chrt08:47:273
3230699633,47cyclictest4170-21chrt08:47:273
3230699633,47cyclictest17590-21taskset11:02:343
3230699633,46cyclictest24103-21chrt11:12:443
3230699633,46cyclictest13737-21chrt10:56:583
3230699632,49cyclictest30777-21chrt11:24:573
3230699632,48cyclictest12228-21chrt09:58:573
3230699632,47cyclictest32532-21taskset09:38:263
3230699632,47cyclictest3168-21taskset11:32:433
3230699632,47cyclictest0-21swapper/308:27:213
3230699623,47cyclictest6311-21chrt10:42:523
3230699623,45cyclictest7797-21chrt11:41:513
3230699622,49cyclictest27023-21taskset08:17:293
3230699622,48cyclictest31768-21taskset08:32:283
3230699622,47cyclictest13054-21chrt11:49:583
3230699622,45cyclictest32741-21taskset10:32:463
3230699622,41cyclictest0-21swapper/311:52:233
3230699613,46cyclictest23320-21chrt08:07:083
3230699613,46cyclictest10767-21chrt09:02:353
3230699613,45cyclictest3939-21chrt07:07:213
3230699613,45cyclictest0-21swapper/310:37:173
3230699613,45cyclictest0-21swapper/310:37:173
3230699613,44cyclictest31009-21chrt12:21:003
3230699613,44cyclictest24744-21chrt10:20:143
3230699613,44cyclictest13757-21chrt09:07:333
3230699613,44cyclictest13757-21chrt09:07:333
3230699613,43cyclictest22562-21chrt09:22:293
3230699612,46cyclictest9306-21taskset10:47:543
3230699612,46cyclictest25429-21chrt09:27:283
3230699612,46cyclictest25429-21chrt09:27:283
3230699612,46cyclictest19282-21chrt09:17:223
3230699612,46cyclictest19282-21chrt09:17:223
3230699612,46cyclictest16435-21chrt07:45:543
3230699612,45cyclictest9930-21taskset11:44:313
3230699612,45cyclictest9759-21chrt07:22:573
3230699612,45cyclictest9759-21chrt07:22:573
3230699612,45cyclictest18685-21taskset10:09:473
3230699612,45cyclictest18685-21taskset10:09:473
3230699603,45cyclictest6021-21chrt07:12:363
3230699603,45cyclictest23696-21chrt08:07:253
3230699603,45cyclictest0-21swapper/308:22:173
3230699603,45cyclictest0-21swapper/308:22:173
3230699603,43cyclictest775-21chrt08:37:223
3230699603,40cyclictest0-21swapper/311:27:193
3230699593,44cyclictest18953-21chrt09:17:063
3230699592,45cyclictest21256-21chrt11:08:433
3230699592,45cyclictest18735-21chrt07:52:303
3230699583,43cyclictest30086-21chrt09:34:583
3230699583,42cyclictest21172-21chrt07:59:233
3230699582,44cyclictest5774-21chrt08:52:253
3230699582,43cyclictest4746-21chrt09:47:223
3230699582,43cyclictest4746-21chrt09:47:223
3230699573,43cyclictest32744-21chrt06:57:293
3230699572,45cyclictest24228-21chrt12:08:193
3230699572,42cyclictest10729-21chrt07:27:313
308272459,21sleep30-21swapper/306:52:243
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional