You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-13 - 16:54
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot7.osadl.org (updated Fri Mar 13, 2026 12:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2972821468,20sleep00-21swapper/007:00:330
311859912224,60cyclictest0-21swapper/012:30:220
2165421170,8sleep221652-21apt10:25:192
311859911630,51cyclictest0-21swapper/009:49:410
311859911053,51cyclictest9442-21sh09:10:420
311859911018,51cyclictest20382uname10:45:450
311859911018,51cyclictest20382uname10:45:450
311859910831,50cyclictest0-21swapper/010:18:340
311859910831,50cyclictest0-21swapper/010:18:340
311859910727,50cyclictest0-21swapper/008:31:530
311859910436,44cyclictest27996-21ssh09:40:560
312029910148,16cyclictest28016-21switchtime08:30:522
311859910139,57cyclictest0-21swapper/009:05:340
311859910136,58cyclictest0-21swapper/011:25:470
31185991012,89cyclictest13554-21apt-get11:05:350
311859910053,42cyclictest31176-21cyclictest08:10:460
31185999854,40cyclictest31176-21cyclictest11:24:040
3118599983,62cyclictest989-21/usr/sbin/munin09:50:410
31185999742,47cyclictest5882-21diskmemload09:35:230
31185999641,49cyclictest544-21cron09:05:190
31185999641,49cyclictest544-21cron09:05:190
31185999515,42cyclictest27651-21kworker/u17:0+xprtiod12:01:410
31185999438,50cyclictest28918-21ssh12:25:180
31185999438,50cyclictest0-21swapper/012:15:210
31185999338,48cyclictest0-21swapper/007:25:190
3118599932,80cyclictest0-21swapper/012:05:290
3118599932,80cyclictest0-21swapper/012:05:290
31185999241,45cyclictest18793-21ssh09:25:480
31185999241,45cyclictest18793-21ssh09:25:480
3118599922,76cyclictest0-21swapper/010:55:290
31185999221,49cyclictest0-21swapper/009:39:100
31185999221,49cyclictest0-21swapper/009:39:100
31185999213,42cyclictest15458-21kworker/u17:1+xprtiod11:11:130
31185999213,42cyclictest15458-21kworker/u17:1+xprtiod11:11:130
31185999211,45cyclictest19145-21kworker/u17:0+xprtiod10:23:050
3084229210,57sleep130844-21sshd07:02:421
31185999143,41cyclictest12637-21ssh09:15:450
31185999143,41cyclictest12637-21ssh09:15:450
31185999136,47cyclictest0-21swapper/008:45:220
3118599912,84cyclictest0-21swapper/011:15:310
31193999071,14cyclictest17315-21fschecks_count12:05:391
31193999071,14cyclictest17315-21fschecks_count12:05:391
31193999069,13cyclictest200-21systemd-journal12:25:181
3118599908,73cyclictest0-21swapper/008:15:340
3118599903,81cyclictest0-21swapper/011:50:310
3118599903,78cyclictest0-21swapper/012:30:330
3118599903,75cyclictest0-21swapper/007:45:300
3118599903,75cyclictest0-21swapper/007:45:300
3118599902,77cyclictest31326-21chrt11:35:220
3118599894,78cyclictest5882-21diskmemload09:55:310
3118599894,76cyclictest32661-21ntp_states08:45:500
3118599894,76cyclictest32661-21ntp_states08:45:500
3118599893,74cyclictest31378-21apt-get07:05:300
3118599893,74cyclictest31378-21apt-get07:05:300
31185998929,49cyclictest0-21swapper/007:25:490
3118599884,74cyclictest0-21swapper/010:30:330
31185998835,47cyclictest0-21swapper/010:05:250
31185998817,64cyclictest0-21swapper/011:35:430
31185998817,64cyclictest0-21swapper/011:35:430
31185998727,54cyclictest17573-21/usr/sbin/munin08:01:290
3118599863,74cyclictest19676-21snmpd11:50:220
31185998631,48cyclictest0-21swapper/011:55:440
31193998546,8cyclictest181rcu_preempt09:50:421
3118599857,72cyclictest0-21swapper/010:50:440
3118599854,68cyclictest9055-21apt-get07:35:310
3118599853,69cyclictest0-21swapper/008:25:330
31185998529,47cyclictest0-21swapper/007:31:500
3118599852,73cyclictest13398-21chrt11:05:220
31185998526,51cyclictest0-21swapper/007:10:230
3118599852,55cyclictest14422-21ssh10:12:000
31202998463,13cyclictest9446-21gpgv10:05:222
31193998465,12cyclictest16316-21ssh11:10:221
3118599844,68cyclictest0-21swapper/008:05:320
3118599843,75cyclictest0-21swapper/010:40:320
3118599842,75cyclictest15602-21uname09:20:440
31193998359,8cyclictest181rcu_preempt10:00:551
31193998355,19cyclictest15502-21fschecks_time09:20:421
3119399832,33cyclictest27045-21latency_hist08:30:211
3118599833,70cyclictest2107-21apt-get11:40:330
31185998326,50cyclictest0-21swapper/012:15:350
31185998326,50cyclictest0-21swapper/010:00:410
31185998313,60cyclictest277-21dbus-daemon07:55:200
31185998313,60cyclictest277-21dbus-daemon07:55:200
31332820,8sleep30-21swapper/308:55:413
31202998258,16cyclictest26954-21sh12:20:542
3118599823,68cyclictest12123-21grep07:45:230
3118599823,68cyclictest12123-21grep07:45:230
3118599823,68cyclictest0-21swapper/008:50:340
3118599822,70cyclictest30241-21ssh10:39:120
3118599822,55cyclictest22534-21/usr/sbin/munin10:25:480
31193998157,15cyclictest31895-21latency_hist12:30:211
31185998120,53cyclictest0-21swapper/008:35:520
31202998061,12cyclictest0-21swapper/209:45:222
31202998059,9cyclictest0-21swapper/208:30:232
31202998059,15cyclictest31176-21cyclictest12:30:372
31193998063,9cyclictest23899-21ssh11:21:361
31193998055,7cyclictest181rcu_preempt08:50:321
31193998043,8cyclictest181rcu_preempt10:28:471
31193998040,25cyclictest15631-21latency_hist10:15:211
3118599802,69cyclictest24063-21apt-get08:20:320
31202997954,19cyclictest544-21cron10:10:192
31193997948,7cyclictest181rcu_preempt11:33:401
31193997947,7cyclictest181rcu_preempt09:40:381
3119399794,26cyclictest31-21ksoftirqd/107:28:091
3118599794,65cyclictest15740-21apt-get07:56:170
31202997858,14cyclictest13948-21sh11:05:432
31202997853,19cyclictest0-21swapper/212:11:482
31202997853,15cyclictest0-21swapper/208:45:422
31202997853,15cyclictest0-21swapper/208:45:422
31193997856,8cyclictest181rcu_preempt11:26:181
31193997819,33cyclictest31-21ksoftirqd/108:03:221
3118599784,67cyclictest3161-21tune2fs08:55:410
3118599783,69cyclictest0-21swapper/007:15:330
31202997758,9cyclictest0-21swapper/210:15:522
31202997758,9cyclictest0-21swapper/210:15:522
3119399779,41cyclictest31-21ksoftirqd/108:11:081
31193997760,10cyclictest17050-21ssh11:10:441
31193997760,10cyclictest17050-21ssh11:10:441
31193997756,15cyclictest31176-21cyclictest09:15:561
31193997756,15cyclictest31176-21cyclictest09:15:561
31193997743,9cyclictest181rcu_preempt07:48:141
31193997743,9cyclictest181rcu_preempt07:48:141
3120999762,31cyclictest6927-21chrt10:00:393
31202997661,7cyclictest0-21swapper/209:55:502
31193997661,8cyclictest0-21swapper/111:00:531
31193997660,10cyclictest30420-21fschecks_count09:45:401
31193997655,10cyclictest0-21swapper/110:06:431
31193997649,19cyclictest28619-21sendmail08:35:201
31193997639,18cyclictest0-21swapper/110:19:421
31193997639,18cyclictest0-21swapper/110:19:421
31193997636,18cyclictest0-21swapper/112:00:231
31193997633,7cyclictest181rcu_preempt07:17:571
3119399762,38cyclictest31-21ksoftirqd/112:33:211
31202997559,8cyclictest0-21swapper/209:05:562
31202997557,9cyclictest0-21swapper/211:25:422
31202997557,8cyclictest0-21swapper/211:20:362
31202997557,10cyclictest0-21swapper/210:30:512
31202997555,13cyclictest0-21swapper/208:05:252
31202997553,16cyclictest4558-21ssh10:50:352
31202997553,14cyclictest3412-21kworker/u17:3-rpciod11:15:442
31202997530,31cyclictest7808-21grep10:55:402
31193997559,10cyclictest9425-21sh09:10:411
31193997555,7cyclictest181rcu_preempt10:49:431
31193997555,7cyclictest181rcu_preempt10:49:431
31193997553,7cyclictest181rcu_preempt11:45:291
31193997542,8cyclictest181rcu_preempt07:56:341
31193997540,10cyclictest181rcu_preempt08:38:011
31193997534,12cyclictest0-21swapper/112:15:461
31193997532,17cyclictest0-21swapper/111:36:391
31193997532,17cyclictest0-21swapper/111:36:391
3119399752,51cyclictest31-21ksoftirqd/108:41:041
3120999742,30cyclictest6058-21chrt09:59:213
31193997453,12cyclictest30611-21kworker/u17:1-xprtiod10:40:541
31193997452,8cyclictest181rcu_preempt09:30:411
31193997447,7cyclictest181rcu_preempt11:50:451
31193997445,7cyclictest181rcu_preempt10:34:591
31193997437,10cyclictest58-21kcompactd009:26:581
31193997437,10cyclictest58-21kcompactd009:26:581
31193997431,18cyclictest0-21swapper/109:36:131
31193997431,18cyclictest0-21swapper/109:36:131
3120999734,26cyclictest6192-21chrt09:05:293
31202997353,14cyclictest31602-21fschecks_time07:05:402
31202997353,14cyclictest31602-21fschecks_time07:05:402
3119399737,28cyclictest31-21ksoftirqd/111:19:001
31193997345,7cyclictest181rcu_preempt10:37:391
3120999723,26cyclictest426-21taskset07:10:223
3120999723,26cyclictest426-21taskset07:10:223
3120299724,24cyclictest39-21ksoftirqd/208:15:522
31193997252,9cyclictest0-21swapper/107:10:571
31193997250,8cyclictest181rcu_preempt08:20:411
31193997250,7cyclictest181rcu_preempt11:40:291
31193997240,7cyclictest181rcu_preempt08:15:451
31193997240,7cyclictest181rcu_preempt08:05:401
3120999713,28cyclictest1998-21chrt09:51:273
3120999713,27cyclictest11003-21taskset07:40:443
3120999713,27cyclictest11003-21taskset07:40:443
31202997157,10cyclictest31176-21cyclictest11:35:412
31202997157,10cyclictest31176-21cyclictest11:35:412
31202997155,8cyclictest0-21swapper/208:50:562
31202997153,13cyclictest12130-21latency_hist09:15:242
31202997152,6cyclictest181rcu_preempt11:57:412
31193997150,7cyclictest181rcu_preempt09:09:391
31193997145,15cyclictest0-21swapper/107:35:231
31193997144,7cyclictest181rcu_preempt10:59:261
310432719,35sleep231071-21munin-run07:05:202
31209997037,24cyclictest320632sleep310:40:573
3120999703,30cyclictest18805-21taskset09:25:493
3120999703,30cyclictest18805-21taskset09:25:493
3120999703,29cyclictest9198-21taskset07:35:373
3120999703,28cyclictest14664-21chrt11:05:583
3120299705,26cyclictest39-21ksoftirqd/211:01:202
31202997050,12cyclictest31176-21cyclictest08:36:272
31202997048,7cyclictest181rcu_preempt10:40:402
31202997048,13cyclictest0-21swapper/212:10:222
31202997048,13cyclictest0-21swapper/212:10:222
31193997042,9cyclictest181rcu_preempt12:11:361
31193997040,7cyclictest181rcu_preempt09:00:421
31193997040,7cyclictest181rcu_preempt09:00:421
31193997031,8cyclictest181rcu_preempt07:10:031
31193997031,8cyclictest181rcu_preempt07:10:031
31193997031,16cyclictest0-21swapper/111:59:331
3120999693,28cyclictest31623-21chrt09:46:533
31209996911,47cyclictest20557-21chrt12:11:133
3120299695,38cyclictest39-21ksoftirqd/212:30:052
31202996950,7cyclictest181rcu_preempt09:35:382
31202996950,7cyclictest181rcu_preempt09:35:382
31202996949,7cyclictest181rcu_preempt10:10:542
31202996948,7cyclictest181rcu_preempt11:54:292
31202996933,10cyclictest16502-21ssh12:04:352
31202996924,32cyclictest7676-21sshd07:30:412
3120299692,24cyclictest39-21ksoftirqd/209:27:132
3120299692,24cyclictest39-21ksoftirqd/209:27:132
31193996955,9cyclictest31176-21cyclictest09:55:381
31193996938,7cyclictest181rcu_preempt07:20:551
3120999683,30cyclictest23718-21chrt11:21:063
3120999683,28cyclictest15373-21chrt07:55:223
3120999683,28cyclictest15373-21chrt07:55:223
31209996812,46cyclictest0-21swapper/309:35:403
31209996812,46cyclictest0-21swapper/309:35:403
31202996853,7cyclictest0-21swapper/209:20:232
31202996848,8cyclictest181rcu_preempt09:45:422
31202996847,15cyclictest15373-21runrttasks07:55:222
31202996847,15cyclictest15373-21runrttasks07:55:222
31202996844,6cyclictest181rcu_preempt09:20:282
31202996843,7cyclictest181rcu_preempt11:11:092
31202996843,7cyclictest181rcu_preempt11:11:092
31193996842,8cyclictest181rcu_preempt10:21:291
31193996841,12cyclictest181rcu_preempt07:53:371
31193996841,12cyclictest181rcu_preempt07:53:371
3119399682,32cyclictest31-21ksoftirqd/108:56:561
3120999673,28cyclictest27883-21chrt12:22:243
31209996717,40cyclictest108702chrt09:12:353
31209996712,43cyclictest0-21swapper/310:20:223
31209996712,43cyclictest0-21swapper/310:20:223
31202996743,6cyclictest181rcu_preempt10:40:082
3120299673,45cyclictest13020-21find07:45:532
3120299673,45cyclictest13020-21find07:45:532
31202996724,19cyclictest39-21ksoftirqd/209:04:432
31202996724,19cyclictest39-21ksoftirqd/209:04:432
31202996723,18cyclictest5882-21diskmemload11:32:242
31193996742,17cyclictest10936-21fschecks_time07:40:421
31193996742,17cyclictest10936-21fschecks_time07:40:421
31193996717,20cyclictest291rcuc/107:35:571
3120999663,28cyclictest28340-21chrt10:35:423
3120999663,28cyclictest20577-21taskset11:15:553
3120299665,26cyclictest39-21ksoftirqd/211:43:442
3120299665,24cyclictest39-21ksoftirqd/207:15:362
31202996651,9cyclictest0-21swapper/207:10:232
31202996647,7cyclictest181rcu_preempt12:17:382
31202996640,9cyclictest181rcu_preempt09:16:152
3120299662,29cyclictest5882-21diskmemload09:50:432
31193996646,7cyclictest181rcu_preempt10:54:361
3120999659,43cyclictest0-21swapper/310:45:553
3120999659,43cyclictest0-21swapper/310:45:553
3120999653,28cyclictest22991-21chrt08:15:483
3120999653,27cyclictest15641-21chrt10:15:193
31209996513,42cyclictest0-21swapper/311:00:233
31209996512,42cyclictest0-21swapper/310:50:443
3120299655,25cyclictest39-21ksoftirqd/208:10:402
31202996536,10cyclictest181rcu_preempt10:46:322
31202996536,10cyclictest181rcu_preempt10:46:322
3120299651,26cyclictest39-21ksoftirqd/211:45:382
3120999643,25cyclictest19906-21chrt10:20:543
3120999642,27cyclictest12769-21taskset11:04:033
31209996413,41cyclictest0-21swapper/308:06:083
31209996412,42cyclictest0-21swapper/311:52:393
3120299643,24cyclictest39-21ksoftirqd/208:58:372
3120299642,27cyclictest39-21ksoftirqd/208:20:322
31193996443,6cyclictest181rcu_preempt08:48:211
31193996443,6cyclictest181rcu_preempt08:48:211
3120999634,25cyclictest11676-21chrt10:07:403
3120999633,26cyclictest28996-21chrt09:42:553
3120999633,26cyclictest23950-21chrt09:35:213
3120999633,25cyclictest16606-21taskset07:56:413
3120999633,25cyclictest11105-21taskset11:55:323
31209996311,40cyclictest0-21swapper/312:25:383
31209996310,44cyclictest0-21swapper/310:25:503
31209996310,43cyclictest0-21swapper/312:30:413
31202996313,36cyclictest21209-21ssh09:30:332
3120999625,13cyclictest0-21swapper/311:30:353
3120999623,41cyclictest25555-21taskset12:19:113
3120999623,26cyclictest3249-21taskset11:41:053
3120999623,20cyclictest17599-21chrt08:00:343
3120999622,25cyclictest2488-21taskset08:53:513
31209996212,41cyclictest0-21swapper/308:20:563
31209996212,41cyclictest0-21swapper/307:30:513
31209996211,42cyclictest0-21swapper/308:40:463
31209996211,42cyclictest0-21swapper/307:50:193
31209996211,42cyclictest0-21swapper/307:50:193
3120299626,32cyclictest39-21ksoftirqd/207:38:102
3120299624,23cyclictest39-21ksoftirqd/207:25:192
31202996241,12cyclictest0-21swapper/207:25:552
3120299623,32cyclictest17335-21latency_hist08:00:232
3120299622,22cyclictest20520-21sshd08:10:092
3120999619,43cyclictest0-21swapper/311:15:223
3120999619,43cyclictest0-21swapper/311:15:223
3120999619,42cyclictest0-21swapper/309:25:223
3120999613,22cyclictest620-21chrt07:10:263
31209996112,40cyclictest0-21swapper/312:05:343
31209996112,40cyclictest0-21swapper/312:05:343
31202996132,9cyclictest181rcu_preempt10:26:342
31202996119,19cyclictest0-21swapper/207:43:592
31202996119,19cyclictest0-21swapper/207:43:592
31202996112,11cyclictest381ktimers/208:45:192
3120999604,35cyclictest32312-21chrt08:45:413
3120999604,35cyclictest32312-21chrt08:45:413
3120999604,12cyclictest0-21swapper/308:10:423
3120999603,23cyclictest4218-21chrt07:20:353
3120999603,23cyclictest28285-21chrt08:31:153
3120999603,23cyclictest14656-21chrt09:19:443
3120999603,23cyclictest14656-21chrt09:19:443
3120999603,22cyclictest31270-21taskset07:05:243
3120999603,22cyclictest26923-21chrt11:26:423
3120999603,21cyclictest16042-21chrt12:03:183
3120999602,25cyclictest6987-21taskset07:28:203
3120999602,23cyclictest7068-21chrt11:48:263
3120999602,21cyclictest26267-21chrt10:31:323
3120999593,22cyclictest4530-21chrt09:00:313
3120999593,22cyclictest4530-21chrt09:00:313
3120999593,20cyclictest30183-21chrt08:39:463
3120999592,21cyclictest3857-21chrt07:19:253
3120999592,19cyclictest26670-21chrt08:26:093
3120999589,12cyclictest0-21swapper/311:35:413
3120999589,12cyclictest0-21swapper/311:35:413
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional