You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-26 - 20:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackfslot4.osadl.org (updated Wed Nov 26, 2025 12:45:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2791622600,1sleep324769-21kworker/u8:607:05:323
2728322570,6sleep118362-21kworker/1:007:05:181
2796722530,8sleep2241rcuc/207:05:352
2875298214208,3cyclictest20658-21kworker/u8:008:17:142
3223021150,2sleep10-21swapper/109:55:551
2875098115107,4cyclictest1050ksoftirqd/008:17:140
287539810393,6cyclictest20664-21kworker/u8:808:17:153
28751989588,4cyclictest9941-21kworker/u8:4110:22:141
28751989587,5cyclictest13279-21kworker/u8:3309:21:541
28751989587,5cyclictest13279-21kworker/u8:3309:21:541
28752987368,3cyclictest13252-21kworker/u8:309:21:542
28752987368,3cyclictest13252-21kworker/u8:309:21:532
28750985344,7cyclictest10-21ksoftirqd/007:11:540
44712500,3sleep22126-21bootmenu10:05:412
28752984741,3cyclictest1384-21kworker/u8:308:52:042
28752984741,3cyclictest1384-21kworker/u8:308:52:032
144782460,2sleep30-21swapper/311:34:393
144782460,2sleep30-21swapper/311:34:393
28751984539,3cyclictest1653-21kworker/u8:707:32:111
28751984539,3cyclictest1653-21kworker/u8:707:32:111
28750984433,8cyclictest10-21ksoftirqd/008:27:330
25022430,2sleep10-21swapper/112:15:231
28751984136,3cyclictest7453-21kworker/u8:1810:17:031
241772410,2sleep20-21swapper/210:46:152
53562400,2sleep15355-21wc12:20:261
140302380,2sleep314031-21cat09:20:003
28751983731,4cyclictest22605-21kworker/u8:1408:22:201
28753983611,5cyclictest2081-21runrttasks08:55:473
28750983630,3cyclictest1050ksoftirqd/009:12:310
28753983529,3cyclictest28405-21kworker/u8:2307:11:553
28751983528,4cyclictest20671-21kworker/u8:1708:17:151
2875398348,6cyclictest1594-1kworker/u9:111:10:453
28753983412,4cyclictest4136-21ntpq10:05:303
28751983326,4cyclictest9353-21kworker/u8:311:47:091
28751983313,12cyclictest121rcu_preempt11:40:151
2875198331,17cyclictest121rcu_preempt09:35:011
28753983211,4cyclictest32137-21timerwakeupswit09:55:413
2875198327,3cyclictest121rcu_preempt08:05:281
243552320,14sleep331-21ksoftirqd/311:55:023
112762320,3sleep30-21swapper/309:13:543
101692320,7sleep331-21ksoftirqd/310:18:253
2875398313,3cyclictest20515-21kworker/u8:609:35:373
28751983115,3cyclictest19-21ksoftirqd/111:35:441
253782310,11sleep331-21ksoftirqd/309:42:213
33012300,15sleep3121rcu_preempt07:25:513
2875398301,6cyclictest12190-21sed07:50:453
28753983011,4cyclictest29972-21/usr/sbin/munin12:05:263
28753983011,4cyclictest1362-21switchtime07:20:473
28752983014,5cyclictest25-21ksoftirqd/211:10:242
2875198308,6cyclictest121rcu_preempt11:10:151
2875198307,4cyclictest121rcu_preempt12:05:231
28751983024,4cyclictest25374-21kworker/u8:1609:47:211
2875198301,9cyclictest30365-21sendmail-mta08:40:001
169862300,1sleep216715-21kworker/u8:1608:05:012
117862300,8sleep225-21ksoftirqd/211:27:542
77992290,6sleep119-21ksoftirqd/111:20:331
2875398294,11cyclictest302832chrt09:53:103
28753982911,4cyclictest9105-21diskmemload10:43:163
2875298293,6cyclictest25-21ksoftirqd/212:20:002
2875298293,3cyclictest121rcu_preempt10:41:102
28752982914,4cyclictest25-21ksoftirqd/211:05:152
2875298291,3cyclictest121rcu_preempt11:50:122
2875298291,3cyclictest121rcu_preempt09:40:162
2875198296,4cyclictest121rcu_preempt08:30:201
2875198293,4cyclictest121rcu_preempt10:55:011
2875198293,4cyclictest121rcu_preempt10:55:001
28751982922,4cyclictest25371-21kworker/u8:810:01:451
2875198291,5cyclictest31732-21ssh11:03:141
2875198291,5cyclictest31732-21ssh11:03:141
28751982915,4cyclictest19-21ksoftirqd/110:05:311
28751982914,4cyclictest19-21ksoftirqd/107:25:291
2875198291,3cyclictest121rcu_preempt09:25:181
2875198291,3cyclictest121rcu_preempt09:25:171
28751982913,3cyclictest19-21ksoftirqd/109:00:291
28751982910,11cyclictest121rcu_preempt11:15:461
28751982910,11cyclictest121rcu_preempt11:15:451
213072290,6sleep331-21ksoftirqd/311:48:103
161682290,7sleep3311ksoftirqd/311:35:553
148122290,9sleep3121rcu_preempt07:56:403
137512290,8sleep12126-21bootmenu09:19:111
90542280,16sleep28590-21kworker/u8:1912:29:402
88862280,2sleep10-21swapper/112:28:421
2875398284,11cyclictest293512chrt10:58:263
2875398284,11cyclictest293512chrt10:58:263
28753982811,4cyclictest9105-21diskmemload09:46:293
28753982810,4cyclictest1836-21ntpq10:00:373
2875298283,2cyclictest121rcu_preempt10:02:052
2875298282,4cyclictest121rcu_preempt10:13:592
2875298282,3cyclictest121rcu_preempt10:33:242
2875298281,4cyclictest121rcu_preempt09:52:592
28752982813,3cyclictest25-21ksoftirqd/211:35:362
2875198287,4cyclictest121rcu_preempt08:10:261
2875198286,14cyclictest121rcu_preempt12:10:371
2875198281,6cyclictest6833-21ntpq10:10:521
28751982815,9cyclictest19-21ksoftirqd/110:41:161
28751982814,3cyclictest19-21ksoftirqd/109:10:351
2875198281,3cyclictest121rcu_preempt07:56:591
28751982813,5cyclictest19-21ksoftirqd/112:30:151
281972280,2sleep20-21swapper/208:31:592
150542280,5sleep225-21ksoftirqd/207:59:452
11502280,16sleep231504-21kworker/u8:1612:11:052
289132270,15sleep116359-21kworker/u8:612:02:561
2875398278,6cyclictest6460-21ntpq09:00:323
2875398276,4cyclictest121rcu_preempt10:51:053
2875398276,4cyclictest121rcu_preempt10:51:053
2875398275,5cyclictest31-21ksoftirqd/312:37:343
2875398273,6cyclictest31-21ksoftirqd/309:05:363
2875398271,3cyclictest11206-21kworker/u8:608:06:393
28753982710,4cyclictest9105-21diskmemload09:33:413
2875298277,3cyclictest121rcu_preempt07:15:362
2875298273,3cyclictest121rcu_preempt12:07:242
2875298273,3cyclictest121rcu_preempt09:55:332
28752982720,4cyclictest1657-21kworker/u8:1007:32:122
28752982720,4cyclictest1657-21kworker/u8:1007:32:112
28752982714,3cyclictest25-21ksoftirqd/210:55:002
28752982714,3cyclictest25-21ksoftirqd/210:55:002
28752982711,4cyclictest25-21ksoftirqd/208:10:372
2875198277,4cyclictest121rcu_preempt10:45:421
2875198276,4cyclictest121rcu_preempt09:05:211
277882270,15sleep224293-21kworker/u8:1310:55:202
277882270,15sleep224293-21kworker/u8:1310:55:192
145902270,3sleep2251ksoftirqd/210:26:162
135942270,2sleep20-21swapper/212:38:282
320672260,5sleep331-21ksoftirqd/307:15:573
2875398266,4cyclictest121rcu_preempt10:35:383
2875398264,5cyclictest31-21ksoftirqd/310:45:303
2875398262,3cyclictest288522kworker/u8:512:15:583
2875298263,3cyclictest121rcu_preempt07:25:522
2875298261,3cyclictest121rcu_preempt11:55:442
2875298261,3cyclictest121rcu_preempt11:24:462
28752982613,4cyclictest25-21ksoftirqd/211:30:142
28752982613,4cyclictest25-21ksoftirqd/211:30:132
28752982613,3cyclictest25-21ksoftirqd/212:30:152
28752982612,4cyclictest25-21ksoftirqd/209:05:132
2875198266,4cyclictest121rcu_preempt11:50:061
2875198266,12cyclictest121rcu_preempt11:25:231
2875198264,4cyclictest121rcu_preempt08:45:291
2875198264,4cyclictest121rcu_preempt08:45:291
2875198263,5cyclictest19-21ksoftirqd/111:55:201
2875198263,4cyclictest121rcu_preempt11:30:401
2875198263,4cyclictest121rcu_preempt11:30:401
2875198262,5cyclictest121rcu_preempt07:20:191
2875198261,4cyclictest121rcu_preempt07:15:271
2875198261,4cyclictest0-21swapper/107:35:201
2875198261,4cyclictest0-21swapper/107:35:191
28751982613,3cyclictest19-21ksoftirqd/109:35:231
28751982611,5cyclictest19-21ksoftirqd/110:25:161
28751982611,3cyclictest19-21ksoftirqd/110:55:221
28751982611,3cyclictest19-21ksoftirqd/110:55:221
250022260,2sleep20-21swapper/208:25:052
111072260,1sleep21390-21kworker/u8:809:12:552
66952250,10sleep331-21ksoftirqd/312:24:553
2875398253,5cyclictest31-21ksoftirqd/308:30:133
2875398252,5cyclictest31-21ksoftirqd/311:20:013
2875398252,5cyclictest31-21ksoftirqd/311:20:013
28753982519,4cyclictest24555-21kworker/u8:7108:27:333
28753982512,4cyclictest32422-21/usr/sbin/munin08:45:263
28753982512,4cyclictest32422-21/usr/sbin/munin08:45:253
2875398251,12cyclictest31-21ksoftirqd/307:46:193
28753982510,4cyclictest9105-21diskmemload11:28:083
28753982510,4cyclictest11203-21ssh10:20:523
2875298253,3cyclictest121rcu_preempt12:00:202
2875298252,3cyclictest121rcu_preempt11:15:292
2875298252,3cyclictest121rcu_preempt11:15:292
2875298252,3cyclictest121rcu_preempt09:00:422
2875298251,3cyclictest121rcu_preempt11:45:152
2875298251,3cyclictest121rcu_preempt11:03:402
2875298251,3cyclictest121rcu_preempt11:03:402
2875298251,3cyclictest121rcu_preempt10:15:362
2875298251,3cyclictest121rcu_preempt09:35:162
2875298251,3cyclictest121rcu_preempt09:30:032
2875298251,3cyclictest121rcu_preempt07:50:392
2875298251,2cyclictest121rcu_preempt08:20:342
2875198259,12cyclictest121rcu_preempt12:35:271
2875198256,11cyclictest121rcu_preempt10:30:121
2875198255,11cyclictest2126-21bootmenu09:50:311
2875198254,4cyclictest121rcu_preempt07:45:371
2875198252,3cyclictest121rcu_preempt10:36:211
2875198251,2cyclictest121rcu_preempt08:57:591
28751982511,3cyclictest19-21ksoftirqd/107:50:421
2875198250,3cyclictest121rcu_preempt07:14:581
261122250,5sleep3311ksoftirqd/311:56:023
28753982417,3cyclictest13712sleep311:06:153
2875398241,12cyclictest245522kworker/u8:6808:23:483
2875298247,4cyclictest121rcu_preempt07:45:152
2875298244,4cyclictest121rcu_preempt11:40:352
2875298243,3cyclictest121rcu_preempt09:15:172
2875298241,3cyclictest121rcu_preempt12:20:172
2875298241,3cyclictest121rcu_preempt09:45:162
2875298241,3cyclictest121rcu_preempt09:25:262
2875298241,3cyclictest121rcu_preempt09:25:262
2875298241,3cyclictest121rcu_preempt08:40:372
2875298241,3cyclictest121rcu_preempt07:35:152
2875298241,3cyclictest121rcu_preempt07:35:142
2875298241,3cyclictest0-21swapper/207:20:262
2875298240,3cyclictest121rcu_preempt10:35:132
2875198248,12cyclictest121rcu_preempt11:05:221
2875198247,10cyclictest31265-21/usr/sbin/munin08:40:281
28751982411,3cyclictest19-21ksoftirqd/109:40:291
28751982411,3cyclictest19-21ksoftirqd/107:40:211
28750982417,4cyclictest10-21ksoftirqd/007:50:150
167252240,2sleep10-21swapper/108:02:051
2875398233,4cyclictest121rcu_preempt11:20:203
2875298232,3cyclictest121rcu_preempt10:20:422
2875298231,3cyclictest121rcu_preempt08:55:172
2875298231,3cyclictest121rcu_preempt08:35:232
2875298231,3cyclictest121rcu_preempt07:40:352
2875298231,2cyclictest121rcu_preempt08:05:482
2875198238,5cyclictest121rcu_preempt08:50:181
2875198238,5cyclictest121rcu_preempt08:50:171
28750982316,4cyclictest118150irq/29-4f00000.11:30:150
28750982316,4cyclictest118150irq/29-4f00000.11:30:140
58812220,2sleep30-21swapper/307:35:013
58812220,2sleep30-21swapper/307:35:003
32092220,5sleep331-21ksoftirqd/308:51:123
32092220,5sleep331-21ksoftirqd/308:51:113
319832220,2sleep30-21swapper/308:42:433
2875398223,3cyclictest121rcu_preempt12:25:393
2875398221,7cyclictest121rcu_preempt11:04:593
2875398221,7cyclictest121rcu_preempt11:04:593
2875398221,5cyclictest5921-21apt-get10:10:213
2875398221,4cyclictest0-21swapper/307:43:393
28753982213,7cyclictest14202-21/usr/sbin/munin09:20:273
28753982213,7cyclictest14202-21/usr/sbin/munin09:20:273
2875298221,3cyclictest121rcu_preempt08:45:172
2875298221,3cyclictest121rcu_preempt08:45:162
2875198228,3cyclictest19-21ksoftirqd/108:25:141
28750982216,4cyclictest10-21ksoftirqd/011:15:340
28750982216,4cyclictest10-21ksoftirqd/011:15:340
28750982216,3cyclictest118150irq/29-4f00000.11:03:520
28750982216,3cyclictest118150irq/29-4f00000.11:03:510
28750982215,4cyclictest118150irq/29-4f00000.10:10:220
28750982211,7cyclictest16480-21sh10:30:350
159432220,11sleep3301rcuc/308:00:263
2875398211,8cyclictest0-21swapper/311:40:123
2875398211,7cyclictest323682kworker/u8:1610:30:113
2875398211,5cyclictest31-21ksoftirqd/309:25:393
2875398211,5cyclictest31-21ksoftirqd/309:25:393
2875398210,3cyclictest121rcu_preempt12:10:433
2875298211,3cyclictest121rcu_preempt07:10:432
2875098218,6cyclictest11412-21sh07:49:590
28750982116,3cyclictest10-21ksoftirqd/008:05:320
28750982115,3cyclictest10-21ksoftirqd/011:50:210
28750982112,6cyclictest3009-21sh12:15:300
28750982112,6cyclictest1844-21sh10:00:370
67762200,2chrt0-21swapper/307:35:253
67762200,2chrt0-21swapper/307:35:243
2875398206,3cyclictest121rcu_preempt08:10:423
2875398202,3cyclictest121rcu_preempt10:25:183
2875398201,3cyclictest121rcu_preempt12:32:483
28750982015,3cyclictest118150irq/29-4f00000.10:35:140
28750982014,4cyclictest10-21ksoftirqd/009:55:390
28750982012,6cyclictest25253-21sh09:41:430
28750982011,7cyclictest2081-21runrttasks08:35:130
28750982011,6cyclictest7603-21/usr/sbin/munin12:25:230
28750982011,6cyclictest28451-21sh10:55:380
28750982011,6cyclictest28451-21sh10:55:380
295212190,8sleep331-21ksoftirqd/308:35:303
2875398192,3cyclictest121rcu_preempt12:00:073
2875098194,10cyclictest118150irq/29-4f00000.08:42:590
2875098192,5cyclictest28512irqrtprio07:25:370
2875098191,5cyclictest0-21swapper/009:25:010
2875098191,5cyclictest0-21swapper/009:25:000
28750981914,3cyclictest26140-21ssh09:45:170
28750981914,3cyclictest19849-21gcc09:30:510
28750981914,3cyclictest11582-21/usr/sbin/munin10:20:560
28750981914,3cyclictest10-21ksoftirqd/009:50:150
28750981914,3cyclictest10-21ksoftirqd/008:30:450
28750981913,4cyclictest10-21ksoftirqd/010:25:330
28750981913,4cyclictest10-21ksoftirqd/009:15:170
28750981913,3cyclictest24735-21ssh11:55:100
28750981913,3cyclictest11798-21ssh12:35:110
28750981913,3cyclictest10-21ksoftirqd/012:20:130
28750981913,3cyclictest10-21ksoftirqd/011:05:150
28750981912,4cyclictest118150irq/29-4f00000.08:00:000
28750981912,4cyclictest10-21ksoftirqd/012:05:260
28750981911,6cyclictest7666-21/usr/sbin/munin11:20:370
28750981911,6cyclictest3891-21aten2_rfpower_p08:55:170
28750981911,6cyclictest2003-21aten2_rfpower_f08:50:180
28750981911,6cyclictest2003-21aten2_rfpower_f08:50:180
28750981911,6cyclictest10275-21wc11:25:220
28750981910,7cyclictest8302-21apt10:15:130
28750981910,6cyclictest5241-21mailstats07:30:510
28750981910,6cyclictest5241-21mailstats07:30:500
28750981910,6cyclictest17716-21timerandwakeup09:25:470
28750981910,6cyclictest17716-21timerandwakeup09:25:470
2875098189,7cyclictest23635-21sh10:45:370
2875098187,9cyclictest109050irq/20-fttdcc0109:00:150
28750981813,3cyclictest8224-21/usr/sbin/munin07:40:210
28750981813,3cyclictest21513-21ssh11:49:190
28750981813,3cyclictest1215-21timerwakeupswit08:45:460
28750981813,3cyclictest1215-21timerwakeupswit08:45:450
28750981813,3cyclictest10-21ksoftirqd/012:30:420
28750981813,3cyclictest10-21ksoftirqd/011:40:230
28750981813,3cyclictest10-21ksoftirqd/007:15:350
28750981812,3cyclictest21351-21ssh09:35:140
28750981812,3cyclictest10-21ksoftirqd/007:39:590
28750981812,3cyclictest10-21ksoftirqd/007:39:590
28750981811,5cyclictest3443-21aten2_rfpower_p10:05:170
28750981810,6cyclictest27891-21missed_timers12:00:250
28750981810,6cyclictest2641-21sh11:10:170
28750981810,6cyclictest25160-21ssh10:50:140
28750981810,6cyclictest25160-21ssh10:50:140
28750981810,6cyclictest16477-21sh11:37:400
28750981810,6cyclictest1415-21sh12:12:200
2875098179,6cyclictest21474-21switchtime10:40:430
2875098178,6cyclictest20492-21timerwakeupswit08:10:440
2875098171,8cyclictest936-21missed_timers07:20:300
28750981712,3cyclictest10-21ksoftirqd/008:00:150
2875098167,7cyclictest10-21ksoftirqd/008:20:180
2875098164,10cyclictest9907-1kworker/u9:207:10:020
28750981611,3cyclictest10-21ksoftirqd/009:05:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional