You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-30 - 20:54
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Tue Jun 30, 2026 12:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
18539910430,35cyclictest0-21swapper/008:58:190
421210211,63sleep0499-21cstates06:53:200
18649910074,20cyclictest4509-21sshd10:38:312
100329911,57sleep21049-21mailstats06:53:422
1859999868,21cyclictest544-21cron08:27:591
1859999868,20cyclictest25053-21latency_hist08:08:031
1859999548,14cyclictest181rcu_preempt11:53:201
185999942,62cyclictest10902-21ssh11:43:281
1859999359,23cyclictest0-21swapper/109:38:371
130529318,46sleep30-21swapper/306:53:483
1864999114,44cyclictest39-21ksoftirqd/211:58:032
1859999145,26cyclictest0-21swapper/110:09:341
1864999018,42cyclictest39-21ksoftirqd/211:18:352
1859999056,14cyclictest181rcu_preempt10:56:491
1853999018,42cyclictest18681-21/usr/sbin/munin09:13:270
1864998966,8cyclictest181rcu_preempt11:44:352
1853998970,14cyclictest20294-21switchtime11:58:340
1853998970,13cyclictest22027-21latency_hist11:08:010
1864998722,33cyclictest39-21ksoftirqd/207:38:302
1853998765,15cyclictest24841-21sh09:23:340
1864998618,37cyclictest39-21ksoftirqd/209:58:182
1864998618,37cyclictest39-21ksoftirqd/209:58:182
1864998564,15cyclictest5623-21latency_hist08:48:022
1864998550,8cyclictest181rcu_preempt09:46:472
1864998550,8cyclictest181rcu_preempt09:46:472
1859998544,10cyclictest181rcu_preempt10:18:341
1853998554,22cyclictest2446-21ls08:38:170
1864998427,24cyclictest39-21ksoftirqd/209:13:212
1864998415,44cyclictest39-21ksoftirqd/210:33:022
1864998413,41cyclictest39-21ksoftirqd/210:48:292
1859998461,8cyclictest181rcu_preempt12:00:101
9692837,52sleep11000-21ps06:53:411
1864998320,31cyclictest39-21ksoftirqd/207:43:252
1864998318,33cyclictest39-21ksoftirqd/211:51:332
1859998361,15cyclictest1841-21cyclictest11:13:221
1859998341,14cyclictest181rcu_preempt10:58:081
1859998337,9cyclictest181rcu_preempt07:08:341
1859998334,10cyclictest181rcu_preempt09:49:411
1853998318,38cyclictest0-21swapper/011:28:280
1864998242,10cyclictest0-21swapper/212:08:182
1859998264,13cyclictest4220-21apt-key10:38:041
1859998257,8cyclictest181rcu_preempt09:55:271
1859998236,31cyclictest13991-21fschecks_count07:33:221
186899813,40cyclictest30570-21chrt10:28:033
186499818,45cyclictest39-21ksoftirqd/210:37:112
1864998145,8cyclictest181rcu_preempt08:38:222
1864998139,11cyclictest0-21swapper/208:48:172
1859998149,11cyclictest181rcu_preempt11:52:591
185999813,22cyclictest28212-21awk09:28:381
1853998158,16cyclictest30350-21idleruntime-cro10:27:590
185399815,65cyclictest27131-21apt-get09:28:130
1864998014,44cyclictest39-21ksoftirqd/207:48:172
1859998063,10cyclictest467-21latency_hist09:38:021
1859998063,10cyclictest467-21latency_hist09:38:021
1859998061,12cyclictest30339-21kworker/u17:3-rpciod10:28:381
1859998058,16cyclictest21374-21fschecks_count09:18:211
1859998058,16cyclictest21374-21fschecks_count09:18:211
1859998042,10cyclictest21986-21ssh11:08:011
1853998015,28cyclictest13529-21apt-get11:48:100
1853998013,32cyclictest0-21swapper/010:58:160
1853998010,27cyclictest352-21runrttasks11:43:160
185399799,27cyclictest0-21swapper/008:18:100
1853997960,13cyclictest5704-21latency_hist08:48:030
1853997951,10cyclictest4851-21ssh09:43:520
1853997951,10cyclictest4851-21ssh09:43:520
185399794,40cyclictest0-21swapper/010:48:130
185399790,42cyclictest2115-21rm09:39:350
1859997859,12cyclictest12574-21ssh10:51:471
1859997847,10cyclictest181rcu_preempt11:26:211
1859997846,9cyclictest181rcu_preempt08:13:371
1859997834,8cyclictest181rcu_preempt08:08:231
1859997831,11cyclictest181rcu_preempt07:13:231
1859997829,13cyclictest0-21swapper/107:18:271
1864997751,7cyclictest181rcu_preempt09:53:222
1864997730,14cyclictest0-21swapper/210:19:522
1864997724,24cyclictest39-21ksoftirqd/208:28:242
1864997717,26cyclictest39-21ksoftirqd/207:28:172
1864997717,26cyclictest39-21ksoftirqd/207:28:172
1864997713,35cyclictest39-21ksoftirqd/207:23:432
1859997738,13cyclictest181rcu_preempt08:43:091
1853997757,14cyclictest988-21latency_hist10:33:020
1853997721,19cyclictest0-21swapper/008:08:190
1853997720,32cyclictest746-21/usr/sbin/munin08:33:250
185399771,44cyclictest5157-21ssh10:39:240
1864997658,13cyclictest7979-21mailstats07:13:332
1864997641,7cyclictest181rcu_preempt10:53:362
1864997611,39cyclictest39-21ksoftirqd/212:16:412
1859997657,12cyclictest300-21rs:main1
1859997657,12cyclictest300-21rs:main1
1859997648,8cyclictest181rcu_preempt08:28:311
1853997618,20cyclictest27081-21chrt12:10:050
186899753,31cyclictest12527-21chrt09:58:023
1864997556,14cyclictest15437-21sh09:08:232
1864997556,14cyclictest15437-21sh09:08:232
1864997538,7cyclictest181rcu_preempt10:25:242
1864997518,34cyclictest39-21ksoftirqd/210:08:032
1864997518,34cyclictest39-21ksoftirqd/210:08:032
1864997516,34cyclictest39-21ksoftirqd/209:33:172
1864997516,34cyclictest39-21ksoftirqd/209:33:172
1859997545,9cyclictest181rcu_preempt09:07:111
1859997541,23cyclictest0-21swapper/111:08:211
1859997541,23cyclictest0-21swapper/111:08:211
185399756,33cyclictest19688-21/usr/sbin/munin10:08:370
1853997518,16cyclictest8579-21ssh09:50:500
186899744,35cyclictest25575-21chrt11:13:243
1864997439,8cyclictest0-21swapper/210:58:312
1859997439,12cyclictest181rcu_preempt10:43:351
1859997439,12cyclictest181rcu_preempt10:43:351
185999742,51cyclictest17874-21sort09:13:021
185999742,51cyclictest17874-21sort09:13:021
1859997423,35cyclictest0-21swapper/111:31:441
185399749,23cyclictest352-21runrttasks07:58:330
185399749,23cyclictest352-21runrttasks07:58:330
185399749,23cyclictest0-21swapper/009:33:060
185399749,23cyclictest0-21swapper/009:33:060
1853997458,9cyclictest22586-21ssh09:19:370
1853997458,9cyclictest22586-21ssh09:19:370
185399745,37cyclictest25538-21fschecks_time11:13:230
1853997412,29cyclictest22795-21/usr/sbin/munin10:13:390
186499734,35cyclictest39-21ksoftirqd/207:18:302
1864997330,8cyclictest181rcu_preempt12:07:052
186499732,37cyclictest39-21ksoftirqd/209:26:242
1864997311,40cyclictest39-21ksoftirqd/208:58:352
1864997310,39cyclictest39-21ksoftirqd/211:29:362
1859997341,8cyclictest181rcu_preempt07:38:171
1859997340,12cyclictest181rcu_preempt08:00:131
1859997340,12cyclictest181rcu_preempt08:00:131
1859997339,11cyclictest181rcu_preempt07:48:281
1859997332,10cyclictest181rcu_preempt09:47:201
1859997332,10cyclictest181rcu_preempt09:47:201
1859997328,13cyclictest181rcu_preempt08:38:021
1859997313,25cyclictest15963-21fschecks_time10:03:231
1859997313,25cyclictest15963-21fschecks_time10:03:231
185399737,28cyclictest23676-21rm11:09:300
185399737,28cyclictest23676-21rm11:09:300
185399736,30cyclictest13330-21apt-get10:53:100
1853997321,14cyclictest2979-21rm10:35:250
1853997318,17cyclictest31729-21ntp_states11:23:300
1853997317,15cyclictest23676-21rm12:03:580
1853997312,24cyclictest18384-21basename10:07:590
1853997312,24cyclictest18384-21basename10:07:590
1853997311,22cyclictest15366-21forks09:08:210
1853997311,22cyclictest15366-21forks09:08:210
186899725,49cyclictest0-21swapper/310:47:593
186899725,49cyclictest0-21swapper/310:47:593
186899723,27cyclictest26623-21taskset12:08:463
1864997254,12cyclictest14275-21sh09:06:322
1864997248,7cyclictest181rcu_preempt09:43:022
186499722,49cyclictest39-21ksoftirqd/208:08:022
1864997217,33cyclictest39-21ksoftirqd/207:53:182
1864997217,33cyclictest39-21ksoftirqd/207:53:182
1864997211,40cyclictest39-21ksoftirqd/209:18:092
1864997211,40cyclictest39-21ksoftirqd/209:18:092
1864997211,30cyclictest39-21ksoftirqd/212:18:232
1859997229,21cyclictest0-21swapper/109:23:161
1859997227,8cyclictest0-21swapper/107:43:111
185999722,42cyclictest23044-21ntp_states12:03:261
1853997259,9cyclictest170-21jbd2/mmcblk2p2-811:53:240
1853997256,10cyclictest31288-21sendmail08:27:590
1853997254,11cyclictest8816-21diskmemload09:07:320
185399725,28cyclictest7934-21/usr/sbin/munin11:38:230
1853997219,25cyclictest0-21swapper/012:13:170
1853997218,17cyclictest416-21chrt08:32:130
1853997218,15cyclictest9631-21chrt10:46:570
1853997218,15cyclictest9631-21chrt10:46:570
185399721,29cyclictest8357-21unixbench_multi08:53:380
1853997211,22cyclictest6440-21awk07:08:340
186899713,26cyclictest24992-21chrt09:23:363
1864997145,8cyclictest181rcu_preempt08:08:212
186499714,43cyclictest39-21ksoftirqd/212:27:352
186499714,43cyclictest39-21ksoftirqd/212:27:352
1864997142,9cyclictest181rcu_preempt08:18:012
1864997140,8cyclictest181rcu_preempt08:36:002
1864997129,9cyclictest0-21swapper/211:40:372
1864997120,21cyclictest39-21ksoftirqd/207:58:192
1864997120,21cyclictest39-21ksoftirqd/207:58:192
1859997152,14cyclictest1841-21cyclictest09:01:151
1859997147,9cyclictest181rcu_preempt07:28:031
1859997142,12cyclictest1900-21ssh12:23:081
1859997142,12cyclictest1900-21ssh12:23:081
1859997137,10cyclictest30086-21ssh12:15:111
1859997130,15cyclictest9969-21ssh11:42:131
185399717,26cyclictest13827-21ssh09:58:460
185399717,26cyclictest13827-21ssh09:58:460
185399715,29cyclictest12762-21/usr/sbin/munin07:28:320
185399715,29cyclictest12762-21/usr/sbin/munin07:28:320
185399713,31cyclictest6206-21uname08:48:250
1853997119,16cyclictest23543-21cpuspeed08:03:170
1853997113,39cyclictest0-21swapper/006:58:230
1853997110,26cyclictest0-21swapper/007:13:380
186899703,31cyclictest19409-21taskset11:58:043
186899703,26cyclictest4739-21chrt09:43:393
186899703,26cyclictest4739-21chrt09:43:393
186899703,26cyclictest10276-21chrt11:42:593
1864997052,13cyclictest31436-21latency_hist08:28:022
1864997047,7cyclictest181rcu_preempt09:51:352
1864997046,8cyclictest181rcu_preempt10:43:332
1864997046,8cyclictest181rcu_preempt10:43:332
1864997041,8cyclictest181rcu_preempt08:22:432
1864997036,7cyclictest181rcu_preempt11:13:362
1859997047,8cyclictest181rcu_preempt11:22:121
185999702,42cyclictest31-21ksoftirqd/107:32:531
185999702,42cyclictest31-21ksoftirqd/107:32:531
1853997052,12cyclictest8816-21diskmemload12:23:340
1853997052,12cyclictest8816-21diskmemload12:23:340
1853997049,15cyclictest32084-21sh12:18:340
185399702,36cyclictest26975-21tune2fs08:13:210
1853997021,10cyclictest0-21swapper/007:53:320
1853997021,10cyclictest0-21swapper/007:53:320
1853997020,13cyclictest9607-21cut07:18:330
1853997019,17cyclictest16014-21/usr/sbin/munin07:38:330
186899694,26cyclictest13383-21chrt09:04:023
186899692,30cyclictest22170-21taskset10:13:273
186899692,29cyclictest343-21chrt09:37:593
186899692,29cyclictest343-21chrt09:37:593
1864996955,10cyclictest1841-21cyclictest07:03:042
1864996952,12cyclictest21574-21latency_hist10:13:032
1864996934,21cyclictest1841-21cyclictest11:35:462
1864996934,21cyclictest1841-21cyclictest11:35:462
1864996925,8cyclictest181rcu_preempt07:36:502
1864996921,13cyclictest0-21swapper/211:58:102
1859996952,9cyclictest291rcuc/110:23:131
185999694,31cyclictest4955-21forks10:39:181
1859996935,9cyclictest181rcu_preempt08:18:361
185999693,44cyclictest31408-21ssh12:18:111
185399698,28cyclictest29974-21rm11:20:390
185399696,29cyclictest17577-21/usr/sbin/munin07:43:310
186899684,29cyclictest18806-21chrt10:08:163
186899684,25cyclictest19589-21chrt11:58:163
186899683,27cyclictest29941-21chrt12:14:463
186899683,23cyclictest29940-21chrt08:23:133
186899682,30cyclictest20151-21chrt07:53:033
1864996853,9cyclictest2404-21kworker/u17:0-writeback11:08:322
1864996853,9cyclictest2404-21kworker/u17:0-writeback11:08:322
1864996849,14cyclictest21267-21sh11:06:112
1864996839,9cyclictest181rcu_preempt08:53:262
186499683,40cyclictest39-21ksoftirqd/207:10:192
1859996839,8cyclictest181rcu_preempt08:58:021
1859996833,15cyclictest181rcu_preempt08:39:311
1859996831,14cyclictest0-21swapper/107:56:271
1859996831,14cyclictest0-21swapper/107:56:271
1859996813,25cyclictest0-21swapper/109:13:381
185399688,23cyclictest27300-21sh10:22:530
185399685,23cyclictest11707-21seq07:25:380
1853996817,17cyclictest11272-21ssh09:54:590
1853996814,34cyclictest3729-21fschecks_count07:03:070
186899673,26cyclictest4804-21taskset11:33:183
186899673,26cyclictest4804-21taskset11:33:183
186899673,26cyclictest22225-21chrt09:18:383
186899673,26cyclictest22225-21chrt09:18:383
186899673,24cyclictest12821-21taskset11:46:573
1864996736,10cyclictest181rcu_preempt09:29:022
1859996737,7cyclictest181rcu_preempt09:58:101
1859996737,7cyclictest181rcu_preempt09:58:101
185999673,41cyclictest6699-21timerwakeupswit08:48:351
1859996727,13cyclictest181rcu_preempt10:18:031
185999672,19cyclictest8816-21diskmemload12:08:271
185399679,21cyclictest4808-21ssh11:33:190
185399679,21cyclictest4808-21ssh11:33:190
186899663,30cyclictest29293-21chrt11:18:433
1864996639,9cyclictest181rcu_preempt11:23:182
1864996618,22cyclictest39-21ksoftirqd/207:02:202
1853996618,14cyclictest19190-21ntp_states07:48:310
186899654,28cyclictest15011-21chrt10:55:163
186899654,24cyclictest16148-21taskset09:08:363
186899654,24cyclictest16148-21taskset09:08:363
186899654,23cyclictest26013-21taskset10:19:153
186899653,30cyclictest17008-21taskset10:04:193
186899653,30cyclictest17008-21taskset10:04:193
186899653,22cyclictest2667-21chrt12:23:343
186899653,22cyclictest2667-21chrt12:23:343
186499652,33cyclictest39-21ksoftirqd/210:14:452
185999657,20cyclictest3664-21munin-node07:03:101
1859996511,10cyclictest19676-21snmpd07:01:551
186899645,46cyclictest0-21swapper/308:43:273
186899643,24cyclictest31495-21chrt10:28:353
186899643,20cyclictest9452-21chrt07:18:283
186899643,20cyclictest16231-21chrt11:53:013
1868996412,41cyclictest0-21swapper/308:58:003
1853996420,9cyclictest13775-21date07:33:030
186899634,41cyclictest4469-21chrt11:33:023
186899633,32cyclictest14849-21taskset10:01:393
186899633,32cyclictest14849-21taskset10:01:393
186899633,21cyclictest29655-21chrt09:32:363
186899633,21cyclictest12782-21chrt07:28:333
186899633,21cyclictest12782-21chrt07:28:333
186899632,25cyclictest1940-21chrt10:33:343
186899632,23cyclictest26417-21taskset08:12:443
186899622,29cyclictest24224-21taskset11:11:053
186899622,29cyclictest24224-21taskset11:11:053
186899622,23cyclictest9086-21taskset09:52:153
186899622,21cyclictest15569-21chrt07:38:213
186899622,20cyclictest10858-21taskset10:48:263
1868996210,40cyclictest0-21swapper/310:39:163
186899613,22cyclictest32218-21taskset11:23:383
186899613,21cyclictest20439-21chrt11:03:513
186899613,20cyclictest27705-21chrt08:13:373
186899612,22cyclictest17018-21taskset07:43:113
186899612,20cyclictest2058-21chrt08:37:303
186899612,19cyclictest4102-21chrt07:03:133
1868996112,40cyclictest0-21swapper/312:18:383
186899603,22cyclictest31571-21chrt08:28:113
186899603,21cyclictest20539-21chrt09:17:163
186899603,20cyclictest2231-21chrt09:39:543
186899602,23cyclictest8586-21chrt07:16:503
186899602,23cyclictest2079-21chrt06:58:153
186899602,20cyclictest24741-21chrt08:07:093
186899602,20cyclictest23230-21chrt08:02:593
186899602,20cyclictest23230-21chrt08:02:593
186899602,20cyclictest18448-21chrt11:01:363
186899594,19cyclictest11716-21chrt07:25:453
186899593,20cyclictest20267-21chrt07:53:113
186899593,20cyclictest20267-21chrt07:53:113
186899593,15cyclictest14062-21chrt07:33:233
186899592,24cyclictest29594-21chrt08:22:163
186899592,20cyclictest6978-21chrt07:11:483
186899592,19cyclictest3426-21chrt08:39:213
1868995912,34cyclictest0-21swapper/312:03:143
186899582,21cyclictest6932-21chrt08:49:443
186899582,19cyclictest9312-21chrt08:58:183
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional