You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-01 - 23:43
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot4.osadl.org (updated Mon Dec 01, 2025 12:45:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2552023380,1sleep321934-21kworker/u8:407:05:533
2534623010,2sleep10-21swapper/107:05:431
2524822850,2sleep223843-1kworker/u9:307:05:392
2620598256250,4cyclictest17021-21kworker/u8:2410:42:232
2620598251244,4cyclictest15865-21kworker/u8:6111:52:012
2620498224215,5cyclictest17023-21kworker/u8:2610:42:231
2620498217209,5cyclictest10985-21kworker/u8:411:52:011
2620198153138,12cyclictest10-21ksoftirqd/010:42:240
2620198145132,10cyclictest10-21ksoftirqd/011:52:020
801221390,3sleep130860-21kworker/1:210:20:031
1950521140,2sleep30-21swapper/310:42:223
205921120,2sleep30-21swapper/311:14:463
26206989891,5cyclictest1572-21kworker/u8:211:52:023
294072800,3sleep20-21swapper/211:03:082
26205987569,4cyclictest15747-21kworker/u8:2808:11:562
26205986861,4cyclictest23443-21kworker/u8:3608:32:212
26205986154,4cyclictest2377-21kworker/u8:609:02:022
250782570,14sleep124994-21kworker/u8:2109:47:381
274262530,6sleep119-21ksoftirqd/108:40:001
250242490,2sleep30-21swapper/312:00:353
26205984842,4cyclictest22176-21kworker/u8:2110:56:512
26206984613,9cyclictest5342-21cron10:14:593
26206984513,9cyclictest31046-21irqrtprio10:00:233
2620698449,10cyclictest6966-21apt-get07:45:173
2620698449,10cyclictest6966-21apt-get07:45:163
26206984416,9cyclictest23828-21ntpq10:50:433
26206984313,11cyclictest9589-21tail11:30:193
26206984312,11cyclictest13833-21/usr/sbin/munin09:25:363
26204984318,16cyclictest19-21ksoftirqd/108:30:131
2620698428,9cyclictest3200-21ntpq11:15:343
26206984211,9cyclictest29093-21ntpq07:15:373
2620698417,10cyclictest21456-21ntpq10:45:503
26206984112,9cyclictest27458-21ntpq12:05:373
26206984112,9cyclictest10227-21switchtime09:15:583
26206984110,10cyclictest2172-21ntpq12:20:313
2620698407,11cyclictest22635-21ntpq11:55:333
26206984012,8cyclictest26385-21/usr/sbin/munin07:10:193
26206984011,9cyclictest12840-21ssh11:35:393
26206984011,10cyclictest3842-21irqrtprio07:35:243
26206984010,8cyclictest1402-21/usr/sbin/munin07:30:283
26205984013,23cyclictest121rcu_preempt08:25:142
2620698398,13cyclictest17883-21ntpq11:45:473
2620698398,11cyclictest796-21apt-config08:55:033
26206983912,10cyclictest26617-21ntpq08:35:393
26206983911,8cyclictest32213-21ntpq12:15:353
26206983911,10cyclictest3669-21ntpq09:00:313
26205983933,4cyclictest8352-21kworker/u8:1107:52:252
26204983933,4cyclictest13871-21kworker/u8:608:11:561
2620698389,8cyclictest6398-21ntpq10:15:263
2620698389,8cyclictest6398-21ntpq10:15:263
2620698387,9cyclictest13295-21diskstats10:30:243
2620698387,11cyclictest26618-21ntpq09:50:293
26206983812,8cyclictest9225-21ntpq10:20:533
26206983812,8cyclictest21841-21ntpq09:40:303
26206983811,9cyclictest30375-21ntp_states08:45:413
26206983811,9cyclictest30375-21ntp_states08:45:413
26206983811,9cyclictest29786-21ntpq12:10:333
26206983811,8cyclictest17046-21ntpq09:30:323
26206983811,7cyclictest9654-21ntpq07:50:333
26206983810,9cyclictest30853-21ntpq07:20:283
2620698379,9cyclictest12339-21ntpq09:20:363
2620698379,13cyclictest2081-21runrttasks08:25:263
2620698378,10cyclictest17376-21ntpq08:10:503
2620698377,9cyclictest28547-21ntpq11:00:363
2620698376,9cyclictest3728-21apt-get12:25:163
2620698376,11cyclictest5938-21ntpq07:40:323
2620698376,11cyclictest5938-21ntpq07:40:323
2620698376,10cyclictest27274-21ssh10:59:283
2620698376,10cyclictest15263-21ntpq08:05:403
26206983711,9cyclictest7235-21ntpq12:30:443
26206983710,8cyclictest5684-21ntpq11:20:373
2620598378,5cyclictest121rcu_preempt09:55:132
2620698369,18cyclictest6379-21diskmemload10:07:213
2620698368,10cyclictest7233-21aten2.4-expect11:25:183
2620698366,9cyclictest7450-21ntpq09:10:283
2620698366,10cyclictest32160-21ntpq08:50:573
26206983610,9cyclictest2044-21snmpd10:25:473
26206983610,9cyclictest2044-21snmpd10:25:473
26205983610,3cyclictest121rcu_preempt09:50:342
26204983622,11cyclictest31565-21kworker/u8:1511:12:061
2620698359,8cyclictest13302-21ntpq08:00:283
2620698357,10cyclictest32716-21ntpq07:25:303
2620698356,10cyclictest19137-21ntpq08:15:343
2620698355,9cyclictest15140-21ntpq11:40:343
26206983511,7cyclictest28447-21ntpq08:40:323
26206983511,4cyclictest16365-21ntpq10:35:453
2620698348,8cyclictest30307-21hddtemp_smartct11:05:233
2620698348,8cyclictest0-21swapper/312:35:123
2620698347,8cyclictest5634-21ntp_states09:05:403
2620698347,7cyclictest24682-21ntpq08:30:293
2620698346,8cyclictest20992-21ntpq08:20:323
2620698346,10cyclictest28375-21aten2.4-expect09:55:193
2620698339,8cyclictest19940-21ssh09:35:543
26206983315,14cyclictest23553-21aten2_rfpower_p09:45:213
26205983317,4cyclictest25-21ksoftirqd/209:30:392
163872320,8sleep1121rcu_preempt11:44:281
2620598318,4cyclictest121rcu_preempt10:25:002
2620598318,13cyclictest121rcu_preempt11:50:002
26205983124,4cyclictest24988-21kworker/u8:1510:01:262
2620598311,3cyclictest121rcu_preempt10:25:192
2620598311,3cyclictest121rcu_preempt10:25:182
258922310,12sleep119-21ksoftirqd/110:55:271
17592310,5sleep11758-21ld10:05:471
2620698304,7cyclictest11441-21ntpq07:55:323
2620598308,4cyclictest121rcu_preempt11:05:232
2620598303,3cyclictest121rcu_preempt09:25:172
2620498302,4cyclictest121rcu_preempt11:25:421
2620598299,3cyclictest121rcu_preempt11:35:242
2620598298,13cyclictest121rcu_preempt11:40:192
2620598297,4cyclictest121rcu_preempt12:15:342
2620598297,14cyclictest121rcu_preempt07:50:012
2620598297,14cyclictest121rcu_preempt07:50:002
2620598295,18cyclictest121rcu_preempt12:10:142
2620598294,5cyclictest121rcu_preempt10:15:242
2620598294,5cyclictest121rcu_preempt10:15:242
2620598293,4cyclictest121rcu_preempt10:06:282
2620598291,4cyclictest121rcu_preempt08:10:012
2620498296,4cyclictest121rcu_preempt11:45:571
2620498295,5cyclictest23673-21latency_hist08:30:001
2620498293,3cyclictest121rcu_preempt07:40:311
2620498293,3cyclictest121rcu_preempt07:40:311
2620498292,5cyclictest4461-21modprobe11:20:001
2620498291,5cyclictest17014-21awk09:30:291
2620498291,4cyclictest121rcu_preempt07:55:181
26201982923,3cyclictest2387-21ssh11:15:160
308062280,15sleep127158-21kworker/u8:1208:46:361
308062280,15sleep127158-21kworker/u8:1208:46:361
289572280,2sleep10-21swapper/111:00:441
2620598288,5cyclictest25-21ksoftirqd/209:40:122
2620598287,4cyclictest121rcu_preempt07:20:012
2620598286,4cyclictest121rcu_preempt12:39:592
2620598286,4cyclictest121rcu_preempt09:15:172
2620598286,4cyclictest121rcu_preempt09:05:262
2620598284,5cyclictest121rcu_preempt11:22:062
2620598282,7cyclictest121rcu_preempt08:00:142
2620498286,6cyclictest121rcu_preempt09:05:201
2620498286,4cyclictest121rcu_preempt10:35:331
2620498286,4cyclictest121rcu_preempt07:20:241
2620498283,5cyclictest121rcu_preempt09:36:051
26204982811,5cyclictest19-21ksoftirqd/108:00:141
79112270,1sleep27891-21kworker/u8:812:32:102
3372270,2sleep20-21swapper/208:53:402
315792270,4sleep119-21ksoftirqd/111:07:091
2620598277,3cyclictest121rcu_preempt10:45:162
2620598276,4cyclictest121rcu_preempt09:20:212
2620598276,4cyclictest121rcu_preempt09:13:452
2620598275,4cyclictest121rcu_preempt11:19:592
2620598275,4cyclictest121rcu_preempt07:25:192
26205982721,3cyclictest21936-21kworker/u8:607:21:412
2620598271,4cyclictest121rcu_preempt07:10:162
26205982714,3cyclictest25-21ksoftirqd/210:50:192
2620498274,10cyclictest985-21ssh12:20:011
2620498271,8cyclictest4542-21latency_hist09:05:011
2620498271,4cyclictest121rcu_preempt08:55:011
132792270,2sleep20-21swapper/210:30:222
82762260,2sleep10-21swapper/109:12:181
45632260,15sleep10-21swapper/107:36:261
288802260,2sleep20-21swapper/208:40:452
286152260,14sleep127982-21kworker/u8:1612:09:451
28552260,2sleep22769-21kworker/u8:707:33:062
2620598269,3cyclictest25-21ksoftirqd/212:05:452
2620598267,12cyclictest25-21ksoftirqd/208:40:002
2620598261,8cyclictest3399-21aten2_rfpower_p07:35:182
2620598261,4cyclictest0-21swapper/209:48:402
26205982614,3cyclictest25-21ksoftirqd/209:39:082
2620598261,3cyclictest121rcu_preempt11:30:332
2620598261,3cyclictest121rcu_preempt10:10:232
26205982613,3cyclictest25-21ksoftirqd/212:20:362
26205982613,3cyclictest25-21ksoftirqd/211:10:172
2620498266,4cyclictest121rcu_preempt10:15:351
2620498266,4cyclictest121rcu_preempt10:15:351
2620498265,5cyclictest121rcu_preempt10:30:281
2620498265,4cyclictest121rcu_preempt07:25:181
2620498264,6cyclictest19-21ksoftirqd/108:05:211
2620498264,5cyclictest26195-21cyclictest12:20:161
2620498264,3cyclictest121rcu_preempt12:30:301
2620498264,3cyclictest121rcu_preempt09:55:241
2620498263,6cyclictest121rcu_preempt11:35:201
2620498263,4cyclictest121rcu_preempt09:50:171
2620498263,3cyclictest121rcu_preempt08:25:011
2620498261,4cyclictest0-21swapper/109:25:011
196602260,1sleep115739-21kworker/u8:2108:16:521
2620598256,4cyclictest121rcu_preempt08:55:152
2620598253,4cyclictest121rcu_preempt08:20:422
2620598253,3cyclictest121rcu_preempt12:25:192
2620598253,3cyclictest121rcu_preempt08:15:152
2620598251,4cyclictest121rcu_preempt11:55:382
2620598250,3cyclictest121rcu_preempt07:55:252
2620498254,3cyclictest121rcu_preempt09:40:321
2620498253,4cyclictest121rcu_preempt07:45:281
2620498253,4cyclictest121rcu_preempt07:45:281
2620498252,3cyclictest121rcu_preempt11:55:111
2620498252,3cyclictest121rcu_preempt10:45:231
2620498252,3cyclictest121rcu_preempt09:25:431
2620498251,7cyclictest24154-21timerwakeupswit10:50:471
88662240,1sleep18364-21kworker/u8:2307:50:171
87302240,2sleep10-21swapper/112:35:111
2620598245,3cyclictest121rcu_preempt10:35:182
2620598244,3cyclictest121rcu_preempt11:25:152
2620598241,3cyclictest121rcu_preempt07:40:222
2620598241,3cyclictest121rcu_preempt07:40:222
26205982411,3cyclictest25-21ksoftirqd/212:00:162
2620498243,4cyclictest121rcu_preempt10:25:291
2620498243,4cyclictest121rcu_preempt10:25:291
2620498242,4cyclictest121rcu_preempt07:10:151
2620498242,3cyclictest121rcu_preempt11:20:411
2620498241,3cyclictest121rcu_preempt08:40:321
2620498241,12cyclictest0-21swapper/111:30:211
26201982419,3cyclictest15178-21rm11:40:350
297282230,1sleep123802-21kworker/u8:007:18:521
2620598238,11cyclictest121rcu_preempt08:45:172
2620598238,11cyclictest121rcu_preempt08:45:162
2620498238,4cyclictest121rcu_preempt10:00:391
2620498234,3cyclictest121rcu_preempt12:25:181
2620498233,6cyclictest121rcu_preempt12:00:281
2620498232,3cyclictest121rcu_preempt10:10:321
2620498232,3cyclictest121rcu_preempt09:15:461
2620498231,3cyclictest121rcu_preempt07:30:371
2620498223,5cyclictest27067-21kworker/u8:108:55:021
2620498221,3cyclictest121rcu_preempt12:10:201
2620198228,11cyclictest22640-21sh09:42:200
2620198216,12cyclictest109050irq/20-fttdcc0109:15:160
26201982116,3cyclictest13859-21ssh09:25:160
26201982116,3cyclictest12863-21sshd08:00:240
26201982115,4cyclictest10-21ksoftirqd/010:10:280
26201982115,4cyclictest10-21ksoftirqd/009:30:370
26201982113,6cyclictest1405-21sshd11:20:110
26201982015,3cyclictest7494-21gcc09:10:310
26201982015,3cyclictest26198-21ssh10:55:370
26201982014,4cyclictest6364-21ssh12:30:240
26201982012,6cyclictest29850-21idleruntime-cro07:20:010
26201982012,6cyclictest29840-21ntp_offset12:10:360
26201982012,6cyclictest24985-21sh12:00:330
26201982012,4cyclictest10-21ksoftirqd/012:35:170
26201982011,6cyclictest23250-21if_eth010:50:280
2620198196,10cyclictest0-21swapper/011:35:260
2620198192,12cyclictest27069-1kworker/u9:008:51:020
26201981914,3cyclictest5624-21ssh10:15:160
26201981914,3cyclictest5624-21ssh10:15:150
26201981914,3cyclictest26680-21ssh09:50:330
26201981914,3cyclictest22787-21ntpq08:25:260
26201981914,3cyclictest10-21ksoftirqd/012:15:160
26201981914,3cyclictest10-21ksoftirqd/011:30:160
26201981913,4cyclictest10-21ksoftirqd/011:55:360
26201981913,3cyclictest10-21ksoftirqd/011:45:200
26201981913,3cyclictest10-21ksoftirqd/010:05:370
26201981913,3cyclictest10-21ksoftirqd/009:00:010
26201981912,5cyclictest26883-21if_err_eth112:05:240
26201981912,4cyclictest10-21ksoftirqd/008:40:260
26201981911,6cyclictest3976-21missed_timers07:35:260
26201981911,6cyclictest30559-21/usr/sbin/munin10:00:160
26201981911,6cyclictest28716-21mailstats11:00:440
26201981911,6cyclictest27462-21switchtime07:10:450
26201981911,6cyclictest25140-21uptime08:30:420
26201981911,6cyclictest2081-21runrttasks09:05:250
26201981911,6cyclictest15463-21aten2_rfpower_e10:35:180
26201981911,6cyclictest14912-21sh10:33:570
26201981911,6cyclictest12603-21sh10:29:190
26201981911,6cyclictest12603-21sh10:29:190
26201981910,6cyclictest8926-21aten2.4-expect07:50:180
26201981910,6cyclictest8159-21mailstats11:25:440
26201981910,6cyclictest6025-21ntpq07:40:410
26201981910,6cyclictest6025-21ntpq07:40:400
26201981910,6cyclictest13063-21sh09:22:160
2620198189,6cyclictest415-21proc_pri07:25:430
2620198189,6cyclictest25533-21latency_hist09:50:020
2620198185,10cyclictest0-21swapper/011:10:250
26201981813,3cyclictest7742-21ld07:45:390
26201981813,3cyclictest7742-21ld07:45:390
26201981813,3cyclictest30910-21ssh11:05:330
26201981813,3cyclictest10-21ksoftirqd/008:45:190
26201981813,3cyclictest10-21ksoftirqd/008:45:190
26201981813,3cyclictest10-21ksoftirqd/008:15:330
26201981812,4cyclictest10-21ksoftirqd/009:35:330
26201981812,3cyclictest10-21ksoftirqd/010:45:160
26201981811,5cyclictest2969-21aten2_rfpower_e09:00:190
26201981811,5cyclictest28590-21irqrtprio09:55:240
26201981811,5cyclictest10265-21sh10:24:330
26201981810,6cyclictest4125-21interrupts12:25:260
26201981810,6cyclictest2081-21runrttasks07:31:220
26201981810,6cyclictest2081-21runrttasks07:20:130
26201981810,6cyclictest11583-21open_files07:55:430
2620198179,6cyclictest25876-21aten2_rfpower_p08:35:220
2620198179,6cyclictest16396-21apt-key08:10:040
2620198174,9cyclictest1348-21ssh12:20:160
26201981712,3cyclictest8191-1kworker/u9:108:05:270
26201981712,3cyclictest10-21ksoftirqd/008:20:170
2620198153,3cyclictest26356-21date07:10:020
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional