You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-29 - 00:55
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot4.osadl.org (updated Fri Nov 28, 2025 12:45:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3130422890,2sleep30-21swapper/307:05:343
3094522650,3sleep230948-21sed07:05:262
3119922490,2sleep10-21swapper/107:05:281
3033821630,3sleep230322-21ssh10:54:592
3208798161148,10cyclictest10-21ksoftirqd/007:52:090
3209298135128,5cyclictest14293-21kworker/u8:3207:52:082
1479621300,2sleep20-21swapper/212:35:222
2002921220,2sleep232083-21cyclictest10:30:552
3209198115110,3cyclictest14305-21kworker/u8:4407:52:091
1318121140,2sleep20-21swapper/210:17:362
1318121140,2sleep20-21swapper/210:17:362
3208798113102,8cyclictest10-21ksoftirqd/008:17:450
320879810896,9cyclictest10-21ksoftirqd/007:36:480
320949810294,5cyclictest12418-21kworker/u8:1107:52:093
320879810094,3cyclictest1050ksoftirqd/009:37:370
32092989082,5cyclictest23540-21kworker/u8:508:17:452
73272840,2chrt0-21swapper/212:20:232
32092988476,6cyclictest1262-21kworker/u8:907:36:472
290612810,2sleep30-21swapper/311:58:023
32091987064,4cyclictest23556-21kworker/u8:2308:17:451
32087986858,7cyclictest10-21ksoftirqd/008:57:410
32091986556,6cyclictest23623-21kworker/u8:3509:37:371
32087986555,7cyclictest10-21ksoftirqd/012:07:080
32087986555,7cyclictest10-21ksoftirqd/012:07:070
32091985852,4cyclictest3546-21kworker/u8:1410:02:121
32087985651,3cyclictest1050ksoftirqd/008:42:200
32087985651,3cyclictest1050ksoftirqd/008:42:200
32094985447,5cyclictest16184-21kworker/u8:1408:17:453
219402500,2sleep225-21ksoftirqd/210:35:302
32094984841,4cyclictest4961-21kworker/u8:3207:36:483
271672480,2sleep327109-21apt-key09:40:063
32094984740,4cyclictest23419-21kworker/u8:409:37:373
32094984438,3cyclictest10011-21kworker/u8:1509:07:563
32094984438,3cyclictest10011-21kworker/u8:1509:07:563
32087984337,3cyclictest1050ksoftirqd/009:47:520
32087984337,3cyclictest1050ksoftirqd/009:47:520
32087984333,7cyclictest10-21ksoftirqd/009:22:150
105642420,3sleep39321-21kworker/u8:1711:20:223
3209498413,3cyclictest121rcu_preempt12:30:173
32092984034,4cyclictest31072-21kworker/u8:912:07:082
32092984034,4cyclictest31072-21kworker/u8:912:07:072
32092983931,5cyclictest418-21kworker/u8:708:42:202
32092983931,5cyclictest418-21kworker/u8:708:42:202
32094983833,3cyclictest14320-21kworker/u8:5907:57:163
32094983832,3cyclictest22645-21kworker/u8:110:52:233
32092983813,6cyclictest121rcu_preempt11:35:302
32087983833,3cyclictest1050ksoftirqd/008:32:050
32091983725,3cyclictest19-21ksoftirqd/111:20:151
32091983722,13cyclictest11336-21kworker/u8:1312:32:441
32087983732,3cyclictest1050ksoftirqd/011:51:500
30612370,3chrt0-21swapper/211:05:172
32422360,2sleep21080-21kworker/u8:209:55:452
187792360,12sleep331-21ksoftirqd/309:22:243
32092983515,4cyclictest25-21ksoftirqd/209:05:402
32092983515,4cyclictest25-21ksoftirqd/209:05:392
82312340,8sleep331-21ksoftirqd/312:20:533
81992340,2sleep10-21swapper/112:20:511
32094983410,4cyclictest121rcu_preempt07:40:253
32092983418,9cyclictest25-21ksoftirqd/210:10:162
32092983417,4cyclictest25-21ksoftirqd/208:45:402
3209198346,4cyclictest121rcu_preempt09:40:131
322912330,18sleep329948-21kworker/u8:2107:10:133
3209298335,6cyclictest121rcu_preempt09:20:132
32092983316,4cyclictest25-21ksoftirqd/210:00:172
32092983315,4cyclictest25-21ksoftirqd/212:15:362
32092983315,4cyclictest25-21ksoftirqd/211:10:322
3209198336,4cyclictest121rcu_preempt11:45:271
3209198336,4cyclictest121rcu_preempt11:45:261
3209298326,5cyclictest25-21ksoftirqd/211:55:292
32092983214,4cyclictest25-21ksoftirqd/207:55:302
3209198328,5cyclictest19-21ksoftirqd/107:10:131
32091983215,4cyclictest19-21ksoftirqd/109:50:141
32087983226,3cyclictest1050ksoftirqd/007:47:010
319422320,7sleep119-21ksoftirqd/110:55:511
25792320,13sleep119-21ksoftirqd/107:15:301
143362320,17sleep119-21ksoftirqd/109:14:141
143362320,17sleep119-21ksoftirqd/109:14:141
3209298317,14cyclictest121rcu_preempt07:25:122
3209298312,3cyclictest121rcu_preempt10:45:152
32092983119,3cyclictest25-21ksoftirqd/211:25:332
32092983111,12cyclictest121rcu_preempt11:40:112
32092983111,12cyclictest121rcu_preempt11:40:102
3209198319,4cyclictest121rcu_preempt07:45:121
3209198317,4cyclictest121rcu_preempt11:30:221
302622310,18sleep10-21swapper/110:54:431
180112310,2sleep10-21swapper/109:20:331
3209298301,5cyclictest0-21swapper/209:50:442
32092983015,4cyclictest25-21ksoftirqd/209:45:372
32092983015,4cyclictest25-21ksoftirqd/209:45:372
32092983014,5cyclictest25-21ksoftirqd/212:10:452
32092983014,4cyclictest25-21ksoftirqd/209:25:292
32092983014,4cyclictest25-21ksoftirqd/208:20:282
3209198302,3cyclictest121rcu_preempt11:15:451
32091983015,4cyclictest19-21ksoftirqd/111:55:121
32087983025,3cyclictest1050ksoftirqd/011:37:250
3209298294,3cyclictest121rcu_preempt11:15:412
32092982916,10cyclictest25-21ksoftirqd/207:40:332
3209298291,5cyclictest121rcu_preempt11:50:152
32092982915,4cyclictest25-21ksoftirqd/208:25:142
32092982915,4cyclictest25-21ksoftirqd/208:00:252
32092982915,4cyclictest25-21ksoftirqd/208:00:242
32092982915,4cyclictest25-21ksoftirqd/207:20:312
32092982915,4cyclictest25-21ksoftirqd/207:20:312
32092982914,8cyclictest25-21ksoftirqd/209:01:072
32092982914,4cyclictest25-21ksoftirqd/208:55:422
32092982914,4cyclictest25-21ksoftirqd/208:35:132
32092982914,3cyclictest25-21ksoftirqd/210:40:302
32092982914,11cyclictest25-21ksoftirqd/209:10:282
32092982914,11cyclictest25-21ksoftirqd/209:10:282
32092982913,4cyclictest25-21ksoftirqd/209:15:172
32092982913,4cyclictest25-21ksoftirqd/208:30:412
32092982913,4cyclictest25-21ksoftirqd/207:15:322
3209198298,4cyclictest121rcu_preempt10:30:271
3209198298,3cyclictest121rcu_preempt12:15:471
3209198295,4cyclictest121rcu_preempt09:35:021
3209198294,4cyclictest121rcu_preempt08:40:171
3209198294,4cyclictest121rcu_preempt08:40:171
3209198293,5cyclictest121rcu_preempt07:25:281
3209198293,4cyclictest121rcu_preempt09:15:431
32091982915,4cyclictest19-21ksoftirqd/112:25:371
32091982915,4cyclictest19-21ksoftirqd/110:35:341
32087982919,7cyclictest10-21ksoftirqd/008:06:340
3208798291,6cyclictest10-21ksoftirqd/012:10:280
32087982911,11cyclictest10-21ksoftirqd/007:20:400
32087982911,11cyclictest10-21ksoftirqd/007:20:400
272392290,15sleep223620-21kworker/u8:3209:40:212
249752290,2sleep30-21swapper/311:50:153
216702290,7sleep1191ksoftirqd/109:29:591
201622290,2sleep36908-21kworker/u8:1111:40:143
201622290,2sleep36908-21kworker/u8:1111:40:133
109002290,2sleep30-21swapper/310:13:153
3209498281,3cyclictest121rcu_preempt10:35:233
32094982811,9cyclictest12984-21irqstats09:10:223
32094982811,9cyclictest12984-21irqstats09:10:223
32092982814,4cyclictest25-21ksoftirqd/210:25:312
32092982814,11cyclictest25-21ksoftirqd/208:50:182
32092982813,4cyclictest25-21ksoftirqd/209:30:402
32092982813,4cyclictest25-21ksoftirqd/207:30:322
32092982813,4cyclictest25-21ksoftirqd/207:10:402
32092982813,3cyclictest25-21ksoftirqd/210:05:372
32092982812,4cyclictest25-21ksoftirqd/211:45:342
32092982812,4cyclictest25-21ksoftirqd/211:45:342
32092982812,3cyclictest25-21ksoftirqd/210:20:282
32092982812,3cyclictest25-21ksoftirqd/210:20:272
32092982811,4cyclictest25-21ksoftirqd/212:25:172
3209298281,14cyclictest0-21swapper/208:10:112
3209198286,4cyclictest121rcu_preempt12:10:031
3209198286,4cyclictest121rcu_preempt12:10:021
3209198285,4cyclictest121rcu_preempt09:05:271
3209198285,4cyclictest121rcu_preempt09:05:271
32091982814,3cyclictest19-21ksoftirqd/112:10:111
32091982812,4cyclictest19-21ksoftirqd/110:05:341
32087982818,7cyclictest10-21ksoftirqd/010:46:180
32087982816,9cyclictest10-21ksoftirqd/011:22:050
27712280,2sleep30-21swapper/312:10:383
275832280,1sleep127467-21kworker/u8:1310:47:561
46972270,16sleep331-21ksoftirqd/312:15:163
3209498271,11cyclictest0-21swapper/307:45:413
3209298271,5cyclictest1448-21ntpq11:00:322
32092982713,4cyclictest25-21ksoftirqd/208:05:322
32092982713,4cyclictest25-21ksoftirqd/207:45:372
32092982712,3cyclictest25-21ksoftirqd/211:20:282
32092982711,3cyclictest25-21ksoftirqd/209:35:412
3209198279,7cyclictest19-21ksoftirqd/111:25:331
3209198273,4cyclictest121rcu_preempt11:05:331
32091982720,4cyclictest6350-21kworker/u8:2108:57:411
3209198271,14cyclictest2619-21sed09:55:291
3208798277,12cyclictest10-21ksoftirqd/010:12:000
32087982722,3cyclictest118150irq/29-4f00000.07:55:370
3208798271,7cyclictest10-21ksoftirqd/011:05:250
250312270,2sleep10-21swapper/110:42:001
218082270,5sleep1191ksoftirqd/111:42:331
218082270,5sleep1191ksoftirqd/111:42:331
169602270,15sleep216536-21kworker/u8:1211:34:462
132192270,6sleep119-21ksoftirqd/110:17:471
132192270,6sleep119-21ksoftirqd/110:17:471
104652270,15sleep18358-21kworker/u8:910:10:521
63842260,15sleep10-21swapper/108:53:031
3209498267,9cyclictest9768-21aten2_rfpower_f12:25:183
3209498267,9cyclictest31-21ksoftirqd/307:15:313
3209498261,6cyclictest3082-21apt-get08:45:153
3209498261,5cyclictest0-21swapper/311:45:273
3209498261,5cyclictest0-21swapper/311:45:263
3209498261,12cyclictest0-21swapper/309:45:213
3209498261,12cyclictest0-21swapper/309:45:213
3209498261,12cyclictest0-21swapper/309:30:313
3209298261,8cyclictest12089-21apt-get12:30:182
3209298261,5cyclictest0-21swapper/210:55:242
32092982611,3cyclictest25-21ksoftirqd/212:00:212
3209198268,3cyclictest27568-21munin-plugin-st08:25:011
3209198265,11cyclictest19-21ksoftirqd/107:20:151
3209198265,11cyclictest19-21ksoftirqd/107:20:151
3209198261,4cyclictest121rcu_preempt07:55:391
32091982612,3cyclictest19-21ksoftirqd/111:40:011
32091982610,4cyclictest30684-21ps12:00:411
32087982621,3cyclictest118150irq/29-4f00000.10:55:000
32087982614,10cyclictest111rcuc/008:45:430
314792260,3sleep331478-21ssh10:55:333
313662260,2sleep10-21swapper/109:48:161
313662260,2sleep10-21swapper/109:48:161
237202260,3sleep1191ksoftirqd/108:13:371
159222260,3sleep315921-21ssh10:24:253
159222260,3sleep315921-21ssh10:24:253
153402260,5sleep119-21ksoftirqd/110:21:101
153402260,5sleep119-21ksoftirqd/110:21:091
100172260,2sleep10-21swapper/109:01:551
5492250,2sleep10-21swapper/108:38:461
324962250,2sleep30-21swapper/312:05:273
324962250,2sleep30-21swapper/312:05:273
3209498254,3cyclictest69122kworker/u8:1511:35:513
3209498252,5cyclictest2908-21latency_hist11:05:013
3209498252,4cyclictest121rcu_preempt07:30:413
3209498252,11cyclictest0-21swapper/308:00:363
3209498252,11cyclictest0-21swapper/308:00:353
3209498251,8cyclictest121rcu_preempt09:50:143
3209498251,6cyclictest6248-21/usr/sbin/munin11:10:333
3209498251,4cyclictest121rcu_preempt12:01:453
3209498251,3cyclictest121rcu_preempt10:25:343
3209498251,14cyclictest4321-21latency07:20:263
3209498251,14cyclictest4321-21latency07:20:253
3209498251,13cyclictest4088-21grep11:05:413
3209498251,13cyclictest29929-21df_inode08:30:333
3209498251,13cyclictest24128-21expr10:40:233
3209498251,13cyclictest20439-21aten2_rfpower_e08:05:173
3209498251,12cyclictest28655-21ntpq08:25:323
3209198253,4cyclictest121rcu_preempt12:35:141
3209198250,5cyclictest0-21swapper/108:25:221
3208798259,8cyclictest11520-21ssh12:28:360
3208798259,5cyclictest13517-21ssh10:19:200
3208798259,5cyclictest13517-21ssh10:19:190
3208798257,11cyclictest10-21ksoftirqd/010:04:440
3208798254,9cyclictest10-21ksoftirqd/011:55:240
3208798254,12cyclictest10-21ksoftirqd/011:33:290
32087982520,3cyclictest118150irq/29-4f00000.09:15:240
3208798251,9cyclictest10-21ksoftirqd/011:40:390
3208798251,9cyclictest10-21ksoftirqd/011:40:390
32087982519,4cyclictest118150irq/29-4f00000.12:00:340
3208798251,8cyclictest10-21ksoftirqd/012:25:010
32087982516,7cyclictest10-21ksoftirqd/010:40:400
310692250,2sleep10-21swapper/108:32:431
235672250,2sleep30-21swapper/308:11:463
106572250,2sleep10-21swapper/107:38:301
81382240,2sleep30-21swapper/308:56:593
3209498247,4cyclictest121rcu_preempt09:15:353
3209498245,4cyclictest121rcu_preempt11:25:363
3209498241,8cyclictest0-21swapper/310:30:303
3209498241,5cyclictest8404-21sort11:15:253
3209498241,4cyclictest0-21swapper/310:05:253
3209498241,15cyclictest0-21swapper/307:25:233
3209498241,14cyclictest5022-21aten2_rfpower_f08:50:203
3209498241,13cyclictest12259-21missed_timers10:15:263
3209498241,13cyclictest12259-21missed_timers10:15:253
3209498241,12cyclictest5172-21ntpq10:00:303
3209498241,12cyclictest2046-21python308:40:413
3209498241,12cyclictest2046-21python308:40:413
3209498241,11cyclictest0-21swapper/309:25:283
3209498240,3cyclictest121rcu_preempt11:30:203
3209198244,5cyclictest121rcu_preempt07:30:161
3209198244,3cyclictest121rcu_preempt10:25:311
3209198243,5cyclictest19-21ksoftirqd/108:50:011
3209198243,3cyclictest121rcu_preempt08:05:161
3209198242,3cyclictest121rcu_preempt11:50:171
3209198241,6cyclictest11065-21apt-get07:40:171
3209198241,4cyclictest121rcu_preempt11:00:171
32091982410,3cyclictest19-21ksoftirqd/111:10:321
3209198240,4cyclictest121rcu_preempt08:00:251
3209198240,4cyclictest121rcu_preempt08:00:251
3208798248,9cyclictest18363-21ssh10:29:480
3208798247,7cyclictest0-21swapper/009:06:360
3208798247,7cyclictest0-21swapper/009:06:360
3208798247,11cyclictest10-21ksoftirqd/008:10:450
3208798242,9cyclictest10-21ksoftirqd/010:05:170
3208798242,5cyclictest0-21swapper/007:15:340
32087982419,3cyclictest118150irq/29-4f00000.08:50:280
3208798241,7cyclictest10-21ksoftirqd/012:15:200
3208798241,7cyclictest10-21ksoftirqd/009:40:160
32087982411,4cyclictest111rcuc/010:35:230
3208798241,10cyclictest10-21ksoftirqd/009:00:490
259732240,3sleep325969-21apt-get08:20:133
3209498232,4cyclictest121rcu_preempt09:55:173
3209498231,5cyclictest14794-21awk12:35:233
3209498231,10cyclictest31777-21hddtemp_smartct08:35:183
3209498231,10cyclictest0-21swapper/310:45:203
3209498231,10cyclictest0-21swapper/309:00:583
3208798239,6cyclictest121rcu_preempt11:15:210
3208798237,5cyclictest121rcu_preempt07:10:360
3208798236,10cyclictest10-21ksoftirqd/009:12:070
3208798236,10cyclictest10-21ksoftirqd/009:12:070
3208798234,6cyclictest121rcu_preempt09:50:540
3208798234,11cyclictest121rcu_preempt10:21:150
3208798234,11cyclictest121rcu_preempt10:21:150
3208798232,15cyclictest10-21ksoftirqd/011:04:140
3208798231,8cyclictest10-21ksoftirqd/011:10:320
32087982317,3cyclictest10-21ksoftirqd/009:55:170
3208798231,5cyclictest0-21swapper/009:25:210
3208798228,6cyclictest121rcu_preempt12:30:270
3208798224,10cyclictest121rcu_preempt12:35:450
3208798222,5cyclictest0-21swapper/008:35:300
3208798221,6cyclictest22850-21ssh11:45:280
3208798221,6cyclictest22850-21ssh11:45:270
32087982216,4cyclictest118150irq/29-4f00000.11:25:410
3208798221,5cyclictest0-21swapper/008:00:440
3208798221,5cyclictest0-21swapper/008:00:430
32087982214,6cyclictest31599-21ssh10:55:390
32087982213,7cyclictest10-21ksoftirqd/007:27:350
3208798219,3cyclictest10-21ksoftirqd/007:30:410
3208798215,8cyclictest12117-21sort07:40:440
3208798202,5cyclictest10-21ksoftirqd/008:25:180
32087982014,3cyclictest18688-21apt-get10:30:140
3208798194,12cyclictest111rcuc/008:20:180
3208798192,10cyclictest23424-21ssh09:31:360
3208798166,7cyclictest109050irq/20-fttdcc0107:10:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional