You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-01 - 08:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackfslot4.osadl.org (updated Mon Dec 01, 2025 00:45:19)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
229898292286,4cyclictest30355-21kworker/u8:2120:27:211
229398283276,4cyclictest1050ksoftirqd/020:27:210
230398269258,7cyclictest30358-21kworker/u8:2420:27:213
227122690,2sleep30-21swapper/319:10:013
227122690,2sleep30-21swapper/319:10:013
140022570,2sleep10-21swapper/119:05:281
140022570,2sleep10-21swapper/119:05:281
217622530,2sleep20-21swapper/219:09:272
217622530,2sleep20-21swapper/219:09:262
229898239232,5cyclictest7444-21kworker/u8:9820:51:551
229398234222,8cyclictest10-21ksoftirqd/020:51:550
230398209203,4cyclictest7446-21kworker/u8:10020:51:553
230098205196,6cyclictest28208-21kworker/u8:120:27:212
230098151142,5cyclictest7363-21kworker/u8:1720:51:552
1161221160,3sleep311596-21ssh23:15:283
1161221160,3sleep311596-21ssh23:15:273
67221000,2sleep10-21swapper/122:53:101
246802940,2sleep324679-21ssh23:43:273
2298987770,5cyclictest11181-21kworker/u8:821:02:111
2298987770,5cyclictest11181-21kworker/u8:821:02:101
2293987059,7cyclictest10-21ksoftirqd/021:02:110
2293987059,7cyclictest10-21ksoftirqd/021:02:100
2298986759,5cyclictest1823-21kworker/u8:4620:37:351
2293986049,8cyclictest10-21ksoftirqd/020:37:350
122482530,4sleep1181rcuc/119:35:251
2298985043,4cyclictest11388-21kworker/u8:2522:16:561
2303984941,6cyclictest11185-21kworker/u8:1221:02:103
2303984941,6cyclictest11185-21kworker/u8:1221:02:103
201712490,2sleep20-21swapper/219:55:252
139742490,2sleep10-21swapper/121:05:281
139742490,2sleep10-21swapper/121:05:271
173392450,2sleep30-21swapper/322:20:173
232412420,3sleep30-21swapper/321:25:233
232412420,3sleep30-21swapper/321:25:233
297552410,1sleep30-21swapper/323:53:533
242392410,3sleep30-21swapper/320:05:403
220882410,3sleep118974-21kworker/u8:420:00:311
217492410,2sleep121748-21/usr/sbin/munin23:35:491
104282410,2sleep30-21swapper/319:30:243
321092400,14sleep119-21ksoftirqd/123:58:461
2293983933,3cyclictest1050ksoftirqd/022:16:550
2303983831,5cyclictest1811-21kworker/u8:3420:37:353
230398381,3cyclictest121rcu_preempt21:40:143
289722360,2sleep30-21swapper/320:20:163
2300983611,4cyclictest429-21/usr/sbin/munin00:00:212
230098352,3cyclictest121rcu_preempt22:55:222
2300983511,4cyclictest32698-21apt-get21:45:162
2293983528,5cyclictest10-21ksoftirqd/021:45:290
266062340,2sleep10-21swapper/121:30:441
2300983410,4cyclictest10014-21aten2_rfpower_p19:30:182
230098338,6cyclictest30369-21df_inode21:40:212
230098338,6cyclictest22395-21seq23:39:022
230098338,4cyclictest0-21swapper/219:50:142
230098332,8cyclictest13794-21tr00:30:272
2300983310,4cyclictest25929-21irqrtprio23:45:392
2300983310,4cyclictest20216-21latency_hist23:35:002
2293983324,6cyclictest10-21ksoftirqd/019:15:190
230398321,3cyclictest121rcu_preempt21:30:153
230098326,4cyclictest11620-21latency_hist21:00:022
230098323,7cyclictest12575-21ntpq21:00:342
230098323,7cyclictest12575-21ntpq21:00:342
230098322,7cyclictest18179-21munin-run00:40:002
230098321,9cyclictest10534-21/usr/sbin/munin22:05:262
230098321,9cyclictest10534-21/usr/sbin/munin22:05:252
230098321,3cyclictest210552kworker/u8:1222:46:032
230098321,3cyclictest210552kworker/u8:1222:46:022
2300983213,16cyclictest2612-21sh00:05:152
2300983213,16cyclictest2612-21sh00:05:152
2300983211,4cyclictest5892-21latency_hist00:15:012
181802320,2chrt0-21swapper/321:15:273
138972320,2sleep113900-21cut00:30:271
230398314,11cyclictest31-21ksoftirqd/321:35:173
230098319,7cyclictest32303-21ntp_states22:50:442
230098318,4cyclictest27918-21aten2_rfpower_e23:50:212
230098316,5cyclictest15661-21latency_hist23:25:022
230098315,4cyclictest0-21swapper/221:10:252
230098312,6cyclictest31313-21/usr/sbin/munin23:55:432
230098311,8cyclictest4221-21cut23:00:242
230098311,7cyclictest17107-21cut19:50:002
163962310,3sleep116380-21ntp_offset21:10:331
51752300,7sleep1191ksoftirqd/100:11:211
230098306,4cyclictest20138-21runrttasks22:25:272
230098302,7cyclictest25908-21irqrtprio21:30:242
230098301,9cyclictest14678-21/usr/sbin/munin22:15:452
230098301,8cyclictest29126-21aten2_rfpower_p20:20:322
230098301,10cyclictest2740-21apt-get21:50:202
229898305,5cyclictest19-21ksoftirqd/123:00:001
88422290,2sleep30-21swapper/319:25:293
230098299,4cyclictest5894-21/usr/sbin/munin21:55:312
230098299,4cyclictest11328-21irqrtprio23:15:272
230098299,4cyclictest11328-21irqrtprio23:15:262
230098298,3cyclictest23154-21users22:30:462
230098298,18cyclictest77702chrt23:07:262
230098298,18cyclictest77702chrt23:07:252
230098296,8cyclictest7683-21kworker/u8:1700:19:592
230098292,3cyclictest101422kworker/u8:500:23:282
230098291,9cyclictest9613-21/usr/sbin/munin23:10:412
230098291,7cyclictest24071-21grep20:05:382
230098291,7cyclictest14820-21grep19:40:422
2300982912,13cyclictest15230-21diskmemload22:41:032
2300982910,4cyclictest247852chrt23:43:582
2300982910,4cyclictest13873-21sh21:05:222
2300982910,4cyclictest13873-21sh21:05:222
229898291,21cyclictest28877-21sendmail_mailqu23:50:421
229398299,11cyclictest10-21ksoftirqd/021:15:400
209432290,7sleep331-21ksoftirqd/322:26:423
147222290,2sleep30-21swapper/322:15:193
10112290,2sleep10-21swapper/100:00:311
89832280,2sleep18990-21irqrtprio00:20:211
88802280,1sleep37676-21kworker/u8:900:20:193
78612280,2sleep10-21swapper/100:17:441
309582280,2sleep30-21swapper/322:49:143
309582280,2sleep30-21swapper/322:49:133
230098286,4cyclictest11774-21aten2_rfpower_c19:35:172
230098285,6cyclictest16440-21/usr/sbin/munin23:25:292
230098285,4cyclictest20247-21latency_hist21:20:012
230098282,6cyclictest12555-21hddtemp_smartct22:10:222
230098282,5cyclictest11879-21ntpq00:25:352
230098281,9cyclictest29860-21basename21:40:012
230098281,8cyclictest252222sleep220:10:212
230098281,7cyclictest7812-21modprobe19:25:012
230098281,7cyclictest4715-21cut19:15:262
2300982810,4cyclictest3465-21timerwakeupswit20:35:432
229898284,3cyclictest121rcu_preempt21:50:451
2298982820,4cyclictest19-21ksoftirqd/119:15:181
2293982810,6cyclictest17693-21aten2_rfpower_p19:50:270
195252280,2sleep10-21swapper/121:16:081
133802280,13sleep331-21ksoftirqd/300:30:093
88522270,5sleep331-21ksoftirqd/322:00:563
88522270,5sleep331-21ksoftirqd/322:00:553
75052270,2sleep30-21swapper/300:16:013
268422270,1sleep326344-21kworker/u8:220:15:133
264462270,1sleep331-21ksoftirqd/323:45:533
230098279,4cyclictest2081-21runrttasks22:35:022
230098277,4cyclictest0-21swapper/220:45:242
230098271,3cyclictest226352kworker/u8:2220:03:382
229398277,10cyclictest10-21ksoftirqd/000:25:020
2293982714,6cyclictest28701-21latency_hist20:20:020
209182270,5sleep1191ksoftirqd/119:58:581
105142270,2sleep10-21swapper/123:14:211
98262260,1sleep10-21swapper/120:55:141
75572260,12sleep3121rcu_preempt23:06:193
75572260,12sleep3121rcu_preempt23:06:183
230098266,4cyclictest4603-21cut20:40:262
230098265,3cyclictest121rcu_preempt20:30:152
230098265,3cyclictest121rcu_preempt20:30:152
230098263,6cyclictest28637-21apt-config20:20:022
230098262,6cyclictest9647-21munin-plugin-st22:05:002
230098262,6cyclictest9647-21munin-plugin-st22:05:002
229898265,6cyclictest121rcu_preempt23:18:251
229898265,6cyclictest121rcu_preempt23:18:241
229898264,6cyclictest19-21ksoftirqd/120:35:001
229898264,6cyclictest19-21ksoftirqd/120:35:001
229898261,12cyclictest11023-21chrt00:25:161
229898260,9cyclictest13341-21ssh23:20:171
229398268,4cyclictest118150irq/29-4f00000.00:35:400
168502260,1sleep313136-21kworker/u8:1721:11:003
151812260,5sleep331-21ksoftirqd/321:09:403
151812260,5sleep331-21ksoftirqd/321:09:393
70792250,3sleep37078-21ssh21:59:183
297592250,3sleep129752-21ntpq20:20:431
291322250,1sleep126854-21kworker/u8:521:36:231
230398252,18cyclictest13336-21ssh23:20:163
230098256,4cyclictest0-21swapper/219:10:452
230098255,4cyclictest0-21swapper/221:25:312
230098255,4cyclictest0-21swapper/221:25:312
230098254,5cyclictest18075-21uname22:20:402
229398258,5cyclictest118150irq/29-4f00000.20:45:000
229398258,10cyclictest5395-21ssh21:55:240
229398256,9cyclictest31002-21ssh21:40:340
229398255,12cyclictest27443-21ntpq22:40:310
2293982516,5cyclictest118150irq/29-4f00000.20:00:150
2293982515,7cyclictest118150irq/29-4f00000.22:50:330
2293982514,8cyclictest10-21ksoftirqd/020:30:150
2293982514,8cyclictest10-21ksoftirqd/020:30:150
2293982512,6cyclictest6730-21missed_timers20:45:280
2293982512,6cyclictest19262-21latency_hist22:25:020
2293982511,6cyclictest11927-21ps23:15:440
2293982511,6cyclictest11927-21ps23:15:440
21252250,1sleep31939-21kworker/u8:921:48:123
72932240,2sleep15502-21kworker/u8:1520:46:131
320562240,2sleep10-21swapper/121:44:111
264432240,5sleep1191ksoftirqd/120:13:141
26262240,2sleep30-21swapper/300:05:193
26262240,2sleep30-21swapper/300:05:193
257782240,13sleep119-21ksoftirqd/122:37:051
230398244,3cyclictest121rcu_preempt23:39:403
229898245,5cyclictest19-21ksoftirqd/123:45:001
229898244,3cyclictest121rcu_preempt21:45:061
229898242,3cyclictest121rcu_preempt21:55:281
229898241,7cyclictest121rcu_preempt21:25:431
229898241,7cyclictest121rcu_preempt21:25:421
229898241,5cyclictest121rcu_preempt19:10:151
229898241,3cyclictest121rcu_preempt22:10:181
229898241,3cyclictest121rcu_preempt21:20:171
229898241,3cyclictest121rcu_preempt21:20:161
229898241,3cyclictest121rcu_preempt19:40:171
229398248,4cyclictest118150irq/29-4f00000.21:00:000
229398246,6cyclictest21180-21latency21:20:260
229398246,6cyclictest21180-21latency21:20:260
229398246,10cyclictest11272-21runrttasks22:06:120
229398246,10cyclictest11272-21runrttasks22:06:110
229398244,9cyclictest10-21ksoftirqd/000:15:270
229398244,12cyclictest9985-21ssh23:11:330
229398243,13cyclictest19494-21aten2_rfpower_f19:55:160
2293982417,4cyclictest118150irq/29-4f00000.23:30:270
2293982412,6cyclictest6872-21latency19:20:290
2293982412,6cyclictest22466-21ssh22:30:260
2293982411,6cyclictest9339-21taskset22:03:270
2293982411,6cyclictest9339-21taskset22:03:260
2293982411,6cyclictest31235-21ps23:55:420
2293982411,6cyclictest28695-21ps21:35:400
228672240,2sleep30-21swapper/320:04:473
202752240,12sleep119-21ksoftirqd/122:25:311
113962240,2sleep30-21swapper/320:58:573
230398237,4cyclictest121rcu_preempt22:59:593
230398231,4cyclictest121rcu_preempt20:00:003
230098239,4cyclictest25-21ksoftirqd/221:20:162
230098239,4cyclictest25-21ksoftirqd/221:20:162
229898235,5cyclictest19-21ksoftirqd/120:45:011
229898232,3cyclictest121rcu_preempt00:35:351
229898231,6cyclictest2081-21runrttasks23:05:431
229898231,6cyclictest2081-21runrttasks23:05:421
229898231,3cyclictest121rcu_preempt23:33:031
229898231,3cyclictest121rcu_preempt23:25:221
229898231,3cyclictest121rcu_preempt23:00:291
2298982313,7cyclictest26947-21sshd23:46:341
229398239,3cyclictest13957-21ssh22:12:400
229398238,2cyclictest0-21swapper/022:25:510
229398235,6cyclictest17121-21runrttasks21:12:250
229398233,12cyclictest5047-21timerwakeupswit23:00:460
2293982316,4cyclictest10-21ksoftirqd/000:10:120
2293982311,6cyclictest28724-1kworker/u9:219:45:010
2293982310,4cyclictest10-21ksoftirqd/022:48:510
2293982310,4cyclictest10-21ksoftirqd/022:48:500
21202230,2sleep331858-21kworker/u8:1300:03:503
160592230,2sleep3121rcu_preempt00:35:203
230398226,4cyclictest121rcu_preempt20:40:303
230398223,5cyclictest31-21ksoftirqd/322:12:293
230398221,5cyclictest31-21ksoftirqd/319:35:153
230398220,3cyclictest121rcu_preempt19:15:273
2298982215,4cyclictest26639-21sh22:40:141
2298982215,3cyclictest19-21ksoftirqd/119:20:201
229898221,3cyclictest121rcu_preempt22:45:391
229898221,3cyclictest121rcu_preempt22:45:391
229898221,3cyclictest121rcu_preempt20:05:391
229398228,11cyclictest118150irq/29-4f00000.21:50:180
229398226,8cyclictest16100-21if_eth123:25:250
229398226,4cyclictest118150irq/29-4f00000.00:30:220
229398222,12cyclictest2976-21ssh00:07:160
229398222,12cyclictest2976-21ssh00:07:160
2293982216,4cyclictest10-21ksoftirqd/021:30:150
229398221,5cyclictest13552ssh22:55:160
2293982211,9cyclictest8196-21sh23:09:430
2293982211,9cyclictest8196-21sh23:09:430
2293982211,5cyclictest20786-21sh23:35:230
183482220,10sleep119-21ksoftirqd/119:50:381
94302210,1sleep19410-21kworker/u8:419:27:161
76892210,10sleep331-21ksoftirqd/319:23:323
47642210,10sleep331-21ksoftirqd/321:54:393
230398217,3cyclictest31-21ksoftirqd/323:30:113
230398212,3cyclictest0-21swapper/321:20:163
230398212,3cyclictest0-21swapper/321:20:163
230398211,4cyclictest121rcu_preempt00:25:203
2303982114,4cyclictest7244-21users20:45:433
2303982114,4cyclictest2081-21runrttasks19:14:593
230398211,3cyclictest121rcu_preempt22:05:363
230398211,3cyclictest121rcu_preempt22:05:353
230398211,3cyclictest121rcu_preempt20:10:323
230098213,6cyclictest8921-21ntp_states19:25:352
229898213,3cyclictest121rcu_preempt00:05:151
229898213,3cyclictest121rcu_preempt00:05:151
229898212,7cyclictest17100-21ls19:50:001
229898211,4cyclictest121rcu_preempt22:25:011
229898211,4cyclictest121rcu_preempt19:30:171
229898211,3cyclictest121rcu_preempt20:15:171
229398219,5cyclictest15642-21aten2_rfpower_v19:45:170
229398218,10cyclictest118150irq/29-4f00000.21:26:300
229398218,10cyclictest118150irq/29-4f00000.21:26:290
229398218,10cyclictest118150irq/29-4f00000.20:10:190
229398217,5cyclictest26307-21/usr/sbin/munin23:45:430
229398216,4cyclictest118150irq/29-4f00000.19:35:000
229398215,13cyclictest118150irq/29-4f00000.23:40:170
229398214,14cyclictest118150irq/29-4f00000.00:00:300
229398212,6cyclictest12103-21if_eth119:35:240
2293982115,3cyclictest118150irq/29-4f00000.20:05:170
2293982114,5cyclictest10-21ksoftirqd/022:35:190
2293982113,6cyclictest81712sleep019:25:170
2293982112,7cyclictest28043-21sshd23:50:220
183802210,7sleep331-21ksoftirqd/319:50:403
175432210,9sleep3301rcuc/323:28:263
151932210,10sleep331-21ksoftirqd/319:44:233
316662200,10sleep331-21ksoftirqd/323:56:223
230398202,2cyclictest121rcu_preempt22:43:243
230398201,4cyclictest25137-21ssh22:35:373
2303982013,4cyclictest9342-21ntpq23:10:303
2303982013,4cyclictest4678-21ntp_states00:10:333
2303982013,4cyclictest32157-21ntpq22:50:303
229898202,11cyclictest2081-21runrttasks22:05:571
229898202,11cyclictest2081-21runrttasks22:05:571
229898201,4cyclictest21909-21aten2_rfpower_e22:30:171
229398207,10cyclictest118150irq/29-4f00000.21:05:360
229398207,10cyclictest118150irq/29-4f00000.21:05:360
229398206,6cyclictest29062-21aten2.4-expect20:20:320
229398206,5cyclictest13691-21cat23:20:240
229398205,7cyclictest0-21swapper/019:13:080
46882190,2sleep30-21swapper/323:00:393
230398191,3cyclictest121rcu_preempt19:45:273
229898191,3cyclictest121rcu_preempt22:00:271
229898191,3cyclictest121rcu_preempt22:00:261
229398199,6cyclictest0-21swapper/000:25:130
12552190,3sleep30-21swapper/320:30:383
12552190,3sleep30-21swapper/320:30:383
233602180,6sleep331-21ksoftirqd/322:31:473
229398184,11cyclictest0-21swapper/019:10:010
229398184,11cyclictest0-21swapper/019:10:000
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional