You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-14 - 00:04
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Sat Jun 13, 2026 12:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
45189912733,59cyclictest0-21swapper/010:39:360
45189912733,59cyclictest0-21swapper/010:39:360
4374212313,74sleep04407-21munin-run06:59:090
45189911627,63cyclictest0-21swapper/008:34:100
45189911551,55cyclictest24288-21latency_hist10:14:130
45189911435,69cyclictest15350irq/295-2188000.ethernet07:09:220
45189911435,69cyclictest15350irq/295-2188000.ethernet07:09:220
4518991123,70cyclictest23124-21apt-get07:54:210
45189910813,59cyclictest0-21swapper/011:53:080
45189910813,59cyclictest0-21swapper/011:53:080
4518991043,66cyclictest5792-21ssh10:36:520
4518991042,63cyclictest24703-21ssh12:03:520
4518991042,61cyclictest23723-21rm11:06:370
45189910342,54cyclictest0-21swapper/009:14:470
4518991024,61cyclictest352-21runrttasks10:50:370
45189910153,41cyclictest1481-21cpuspeed11:24:260
45189910143,51cyclictest0-21swapper/012:09:120
4523999978,14cyclictest7386-21processes08:44:431
4523999938,36cyclictest7561-21sh10:39:421
4523999938,36cyclictest7561-21sh10:39:421
4518999913,63cyclictest8970-21kworker/u17:3+xprtiod11:40:390
4518999913,58cyclictest18061-21sh10:04:040
4523999822,37cyclictest12780-21sed10:49:121
4518999718,54cyclictest13596-21fschecks_time11:44:320
451899964,59cyclictest0-21swapper/010:33:010
451899964,59cyclictest0-21swapper/010:33:010
4518999642,45cyclictest0-21swapper/008:39:440
451899963,81cyclictest11961-21apt-get08:59:260
4518999635,51cyclictest0-21swapper/011:03:510
451899963,54cyclictest0-21swapper/011:32:450
451899962,59cyclictest352-21runrttasks12:13:510
451899962,55cyclictest4123-21seq08:34:400
4523999524,35cyclictest352-21runrttasks08:10:141
451899956,63cyclictest58-21kcompactd010:49:100
451899953,55cyclictest0-21swapper/011:23:240
4523999425,32cyclictest1269-21idleruntime-cro12:19:091
451899944,82cyclictest0-21swapper/010:54:230
451899943,83cyclictest0-21swapper/012:14:200
451899943,55cyclictest0-21swapper/010:04:300
4518999421,62cyclictest10241-21tune2fs07:14:330
4523999325,29cyclictest3104-21runrttasks10:32:441
4523999325,29cyclictest3104-21runrttasks10:32:441
4523999324,28cyclictest27950-21netstat10:19:371
451899933,82cyclictest11600-21apt-get07:19:220
453299926,50cyclictest39-21ksoftirqd/207:25:372
451899924,56cyclictest29104-21seq08:11:320
451899923,56cyclictest32099-21seq09:32:440
451899923,56cyclictest32099-21seq09:32:440
4518999235,50cyclictest0-21swapper/008:54:110
4518999228,59cyclictest0-21swapper/009:49:120
4518999228,59cyclictest0-21swapper/009:49:120
4523999123,29cyclictest26650-21sh09:24:101
4523999117,36cyclictest0-21swapper/110:59:471
4518999141,44cyclictest28095-21ssh09:24:570
451899913,55cyclictest0-21swapper/007:39:430
451899912,54cyclictest0-21swapper/007:35:350
4518999112,44cyclictest24394-21kworker/u17:2+xprtiod10:23:170
4532999026,31cyclictest39-21ksoftirqd/209:03:292
4523999021,25cyclictest24984-21ssh10:14:401
451899909,45cyclictest5831-21kworker/u17:1+xprtiod09:53:350
4518999031,53cyclictest0-21swapper/009:57:100
4518999031,53cyclictest0-21swapper/009:57:100
451899902,59cyclictest29732-21seq11:16:480
451899902,53cyclictest26164-21seq10:16:350
34092909,57sleep13452-21latency06:54:421
4523998927,24cyclictest22831-21seq07:54:021
4523998922,28cyclictest9759-21systemd-run07:14:101
4523998922,28cyclictest9759-21systemd-run07:14:101
4523998920,32cyclictest0-21swapper/111:54:481
451899894,74cyclictest21514-21apt-get07:49:230
451899893,55cyclictest0-21swapper/011:54:180
451899892,77cyclictest4030-21/usr/sbin/munin09:39:380
451899892,58cyclictest23887-21runrttasks09:19:140
453299882,42cyclictest39-21ksoftirqd/209:05:522
4523998832,23cyclictest0-21swapper/107:35:421
4523998827,24cyclictest21185-21seq07:48:551
451899884,77cyclictest30526-21cstates10:24:280
451899883,78cyclictest2374-21systemd-journal08:29:090
451899883,53cyclictest0-21swapper/011:35:290
451899883,53cyclictest0-21swapper/011:35:290
4518998829,53cyclictest0-21swapper/009:14:090
4518998829,53cyclictest0-21swapper/009:14:090
451899882,79cyclictest0-21swapper/007:59:250
4518998823,58cyclictest0-21swapper/009:04:260
4532998763,15cyclictest12178-21sh09:54:112
4532998742,11cyclictest181rcu_preempt12:24:592
4523998728,24cyclictest12867-21seq07:23:271
4523998726,19cyclictest28146-21seq09:25:051
4523998724,24cyclictest30769-21ssh12:14:091
4523998720,24cyclictest19676-21snmpd10:58:081
451899875,47cyclictest0-21swapper/008:58:010
451899875,47cyclictest0-21swapper/008:58:010
451899873,72cyclictest352-21runrttasks12:19:240
451899873,72cyclictest352-21runrttasks12:19:240
451899873,55cyclictest0-21swapper/011:11:120
451899872,57cyclictest4503-21seq12:24:180
4532998638,13cyclictest16771-21memory11:49:362
4532998638,13cyclictest16771-21memory11:49:362
4532998611,44cyclictest39-21ksoftirqd/211:07:232
4523998629,24cyclictest1399-21seq08:25:371
4523998627,22cyclictest3105-21seq08:31:321
4523998626,25cyclictest14487-21seq07:28:371
4523998622,23cyclictest9972-21seq07:14:191
451899863,59cyclictest2523-21ssh09:37:270
4518998632,47cyclictest0-21swapper/008:19:310
4518998632,47cyclictest0-21swapper/008:19:310
451899862,75cyclictest4691-21/usr/sbin/munin06:59:480
451899862,59cyclictest29733-21taskset08:14:280
4518998625,51cyclictest0-21swapper/007:29:320
4518998625,51cyclictest0-21swapper/007:29:320
4532998512,35cyclictest39-21ksoftirqd/207:17:152
4523998526,25cyclictest12163-21seq11:41:571
4523998526,24cyclictest27603-21seq08:08:151
4523998526,23cyclictest30713-21seq08:16:341
4523998525,24cyclictest352-21runrttasks10:51:261
4523998524,26cyclictest25833-21seq08:01:151
4523998523,23cyclictest12636-21ps08:59:431
4523998520,31cyclictest630-21tr10:29:091
4523998518,25cyclictest9549-21cat09:49:271
451899853,72cyclictest0-21swapper/008:44:230
4532998463,8cyclictest181rcu_preempt12:01:402
4523998429,20cyclictest26588-21seq11:11:161
4523998428,23cyclictest15907-21seq07:30:481
4523998428,23cyclictest15907-21seq07:30:481
4523998426,29cyclictest9587-21seq08:51:461
4523998426,24cyclictest7995-21seq07:08:041
4523998426,24cyclictest7995-21seq07:08:041
4523998425,23cyclictest5879-21seq07:02:081
4523998422,32cyclictest5083-21processes11:29:431
42622847,50sleep24263-21sshd06:57:412
4532998315,37cyclictest39-21ksoftirqd/210:55:112
4523998328,24cyclictest8826-21seq11:35:531
4523998328,24cyclictest8826-21seq11:35:531
4523998327,27cyclictest352-21runrttasks12:02:121
4523998327,26cyclictest16902-21taskset10:00:481
4523998326,27cyclictest23442-21taskset09:18:401
4523998325,22cyclictest32451-21seq08:23:181
4523998325,22cyclictest32451-21seq08:23:181
4523998322,28cyclictest4265-21fschecks_time10:34:321
4523998318,28cyclictest0-21swapper/111:22:481
4523998316,30cyclictest4820-21ssh09:40:291
4532998261,15cyclictest16457-21apt-key07:34:142
4532998261,15cyclictest16457-21apt-key07:34:142
4532998238,11cyclictest4509-21cyclictest07:19:462
4523998246,25cyclictest18416-21apt-get10:04:221
4523998226,21cyclictest6245-21seq08:40:321
4523998225,28cyclictest29127-21taskset11:15:041
4523998223,27cyclictest7422-21latency_hist12:29:121
4523998222,27cyclictest1696-21tune2fs11:24:321
451899822,72cyclictest14771-21latency_hist07:29:130
4532998157,9cyclictest181rcu_preempt09:24:342
4532998112,53cyclictest22449-21grep10:09:482
4523998127,24cyclictest15470-21ssh09:04:371
4523998127,22cyclictest4736-21seq08:36:471
4523998118,28cyclictest0-21swapper/109:34:441
451899813,69cyclictest0-21swapper/007:44:210
453799803,35cyclictest25524-21chrt11:09:373
4532998054,17cyclictest8440-21sh11:34:492
4532998054,17cyclictest8440-21sh11:34:492
4532998051,20cyclictest30602-21sh10:24:322
4523998026,25cyclictest9033-21runrttasks09:48:581
4523998026,25cyclictest9033-21runrttasks09:48:581
4523998026,23cyclictest24364-21seq07:58:031
4523998025,24cyclictest15315-21seq11:47:291
4523998025,23cyclictest19373-21seq07:41:101
4523998022,26cyclictest1-21systemd12:09:101
4523998020,24cyclictest722-21kworker/u18:1+rpciod09:09:311
4523998020,24cyclictest722-21kworker/u18:1+rpciod09:09:311
4523998019,28cyclictest0-21swapper/111:49:371
4523998019,28cyclictest0-21swapper/111:49:371
4523998018,27cyclictest0-21swapper/109:29:381
4523998018,27cyclictest0-21swapper/109:29:381
451899803,70cyclictest0-21swapper/007:04:230
451899803,70cyclictest0-21swapper/007:04:230
196852800,12sleep2371rcuc/210:59:432
4523997928,28cyclictest11434-21seq08:56:441
4523997928,28cyclictest11434-21seq08:56:441
4523997925,22cyclictest23209-21sh10:11:411
4523997924,24cyclictest3312-21seq12:21:341
4523997924,24cyclictest3312-21seq12:21:341
4532997835,11cyclictest18009-21latency_hist07:39:122
4532997831,9cyclictest0-21swapper/210:37:252
453299777,44cyclictest39-21ksoftirqd/207:12:332
453299777,44cyclictest39-21ksoftirqd/207:12:332
4532997737,8cyclictest181rcu_preempt12:23:422
4532997737,8cyclictest181rcu_preempt12:23:422
4523997723,20cyclictest13824-21taskset09:55:331
4523997723,20cyclictest13824-21taskset09:55:331
451899772,63cyclictest27838-21wc08:09:130
4532997651,18cyclictest22014-21unixbench_singl09:14:482
4532997650,11cyclictest181rcu_preempt09:45:472
4532997650,11cyclictest181rcu_preempt09:45:472
4532997646,8cyclictest181rcu_preempt08:24:412
4532997646,8cyclictest181rcu_preempt06:59:452
4532997635,23cyclictest23319-21fschecks_count07:54:312
4532997635,11cyclictest16063-21ssh11:49:132
4532997557,12cyclictest8096-21cron07:09:102
4532997557,12cyclictest8096-21cron07:09:102
4532997549,9cyclictest181rcu_preempt10:06:252
4532997547,8cyclictest181rcu_preempt10:21:042
4532997547,18cyclictest12571-21sh09:54:282
4532997547,18cyclictest12571-21sh09:54:282
453299754,44cyclictest39-21ksoftirqd/212:09:382
4532997537,20cyclictest12645-21ssh10:49:102
4532997530,11cyclictest0-21swapper/211:41:282
4532997526,20cyclictest0-21swapper/211:11:062
4523997554,15cyclictest24691-21sh11:09:111
453799743,33cyclictest5683-21chrt12:24:543
4532997427,17cyclictest0-21swapper/210:42:582
4532997427,17cyclictest0-21swapper/210:42:582
453799733,33cyclictest7723-21chrt10:39:453
453799733,33cyclictest7723-21chrt10:39:453
4532997342,13cyclictest181rcu_preempt11:30:302
4532997339,11cyclictest181rcu_preempt09:36:332
4532997315,35cyclictest39-21ksoftirqd/208:30:432
4532997312,30cyclictest39-21ksoftirqd/212:14:532
4532997311,33cyclictest39-21ksoftirqd/210:00:492
4532997250,15cyclictest4966-21systemd-run08:39:112
4532997243,15cyclictest181rcu_preempt09:43:012
4532997238,9cyclictest181rcu_preempt11:56:582
453299723,41cyclictest39-21ksoftirqd/207:49:262
4532997145,11cyclictest181rcu_preempt11:18:172
453299714,33cyclictest39-21ksoftirqd/210:32:242
453299714,33cyclictest39-21ksoftirqd/210:32:242
4532997141,8cyclictest181rcu_preempt11:19:572
4532997132,9cyclictest181rcu_preempt12:04:442
4532997125,10cyclictest0-21swapper/210:52:562
453299712,37cyclictest10373-21sshd08:55:562
453299712,37cyclictest10373-21sshd08:55:562
4532997048,15cyclictest4509-21cyclictest09:29:492
4532997048,15cyclictest4509-21cyclictest09:29:492
4532997046,8cyclictest181rcu_preempt08:04:432
4532997046,10cyclictest181rcu_preempt11:27:552
4532997039,12cyclictest181rcu_preempt08:20:482
4532997039,12cyclictest181rcu_preempt08:20:482
4532997026,9cyclictest181rcu_preempt08:14:452
4532996935,17cyclictest181rcu_preempt08:50:122
453299686,36cyclictest39-21ksoftirqd/207:41:022
4532996837,10cyclictest181rcu_preempt10:15:542
4532996836,7cyclictest181rcu_preempt08:44:402
4532996812,31cyclictest39-21ksoftirqd/208:03:582
4532996744,12cyclictest0-21swapper/208:09:442
4532996740,8cyclictest181rcu_preempt09:21:422
4532996733,13cyclictest181rcu_preempt09:10:542
4532996733,13cyclictest181rcu_preempt09:10:542
4532996713,32cyclictest39-21ksoftirqd/207:45:072
384126711,31sleep30-21swapper/306:54:573
453799664,35cyclictest0-21swapper/307:34:263
453799623,43cyclictest16526-21chrt09:59:473
4537996234,20cyclictest0-21swapper/309:34:093
4537996234,20cyclictest0-21swapper/309:34:093
4532996226,11cyclictest0-21swapper/208:39:262
453799613,40cyclictest917-21kworker/3:1+events08:24:443
453799604,38cyclictest7563-21taskset07:04:473
453799604,38cyclictest7563-21taskset07:04:473
453799594,37cyclictest17487-21taskset09:08:473
453799593,40cyclictest19097-21chrt11:54:133
453799593,40cyclictest19097-21chrt11:54:133
453799593,36cyclictest917-21kworker/3:1+events09:14:403
453799584,37cyclictest13886-21chrt11:44:403
453799584,32cyclictest0-21swapper/310:49:203
453799583,40cyclictest21985-21chrt11:04:223
453799583,39cyclictest4880-21chrt10:34:463
453799574,37cyclictest12586-21chrt11:43:103
453799564,38cyclictest21010-21chrt11:02:193
453799563,41cyclictest0-21swapper/308:54:383
453799563,41cyclictest0-21swapper/308:54:383
453799563,39cyclictest25735-21chrt12:04:393
453799563,39cyclictest12972-21taskset07:24:113
453799563,38cyclictest7216-21chrt09:44:433
453799563,38cyclictest7216-21chrt09:44:433
453799563,38cyclictest5141-21taskset08:39:133
453799563,37cyclictest6181-21taskset11:31:473
453799563,36cyclictest3783-21chrt09:39:323
453799563,36cyclictest11924-21chrt08:59:183
453799562,41cyclictest29302-21chrt08:14:103
453799553,37cyclictest16231-21taskset07:34:113
453799553,37cyclictest16231-21taskset07:34:113
453799553,35cyclictest10399-21taskset10:44:353
453799553,34cyclictest30853-21taskset10:24:363
453799552,39cyclictest898-21taskset12:18:093
453799545,34cyclictest10139-21taskset11:39:123
453799545,34cyclictest10139-21taskset11:39:123
453799544,32cyclictest28155-21chrt11:14:313
453799543,36cyclictest30148-21chrt12:12:253
453799543,35cyclictest27698-21taskset09:24:443
453799542,39cyclictest2878-21taskset10:32:063
453799542,39cyclictest2878-21taskset10:32:063
453799542,34cyclictest26949-21taskset08:04:423
453799535,35cyclictest7464-21taskset08:44:443
453799533,37cyclictest1820-21chrt12:19:313
453799533,37cyclictest1820-21chrt12:19:313
453799532,38cyclictest26106-21taskset10:16:253
453799524,34cyclictest16249-21chrt10:54:293
453799523,37cyclictest28959-21taskset10:21:043
453799523,36cyclictest21983-21chrt11:59:113
453799523,34cyclictest30835-21chrt11:19:143
453799522,38cyclictest1008-21chrt09:34:373
453799522,36cyclictest13201-21chrt09:54:443
453799522,36cyclictest13201-21chrt09:54:443
453799522,33cyclictest9081-21chrt07:09:453
453799522,33cyclictest9081-21chrt07:09:453
453799514,33cyclictest9882-21chrt08:54:113
453799514,32cyclictest22512-21chrt11:59:323
453799513,35cyclictest5479-21chrt06:59:443
453799513,32cyclictest23628-21chrt07:54:383
453799512,36cyclictest18384-21chrt07:39:273
453799512,35cyclictest20612-21taskset10:07:503
453799512,31cyclictest23078-21taskset07:54:133
453799504,33cyclictest11479-21chrt07:19:123
453799503,33cyclictest20781-21chrt07:44:453
453799502,34cyclictest18716-21chrt09:09:443
453799502,34cyclictest18716-21chrt09:09:443
453799493,35cyclictest2865-21taskset11:25:513
453799493,29cyclictest21681-21chrt10:09:323
453799492,32cyclictest10947-21chrt09:50:513
453799483,31cyclictest2139-21chrt08:29:333
453799483,28cyclictest31488-21chrt08:19:333
453799483,28cyclictest31488-21chrt08:19:333
453799482,33cyclictest25865-21chrt09:22:043
453799473,30cyclictest30558-21taskset08:14:473
453799463,29cyclictest14735-21chrt07:29:133
453799423,30cyclictest5909-21chrt08:39:423
453799393,25cyclictest24875-21chrt07:59:283
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional