You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-03 - 03:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Wed Dec 03, 2025 00:44:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
239521720,3sleep11166899cyclictest21:52:041
699121540,2sleep20-21swapper/221:13:332
1290021440,20sleep0135650irq/27-eth021:14:090
2683621320,3sleep30-21swapper/323:25:303
1493921280,4sleep20-21swapper/223:45:522
2116121270,3sleep21167099cyclictest23:31:022
2828721220,4sleep21167099cyclictest21:24:372
1983321200,1sleep019831-21bash22:02:460
1944421180,0sleep00-21swapper/023:30:510
11281211331,44sleep10-21swapper/119:08:041
64921110,0sleep11847-21nfsd23:35:181
11217211132,42sleep30-21swapper/319:07:173
779121100,2sleep00-21swapper/000:33:160
930421050,0sleep00-21swapper/023:42:180
270622960,0sleep01166099cyclictest22:18:290
319292950,3sleep20-21swapper/222:06:532
117552940,2sleep31848-21nfsd21:10:513
273642930,1sleep11166899cyclictest23:47:081
238772930,1sleep023865-21sshd00:38:090
195592930,3sleep20-21swapper/223:55:352
51722900,0sleep15170-21bash21:16:211
213542880,2sleep11848-21nfsd21:32:531
302572870,1sleep20-21swapper/223:50:262
146952870,4sleep10-21swapper/123:52:051
105272870,1sleep10-21swapper/100:17:181
304042860,1sleep30-21swapper/322:36:563
269502860,2sleep326941-21sshd23:56:203
125882860,0sleep00-21swapper/023:45:390
291442850,6sleep31167799cyclictest23:01:173
39642840,2sleep20-21swapper/200:13:262
221802840,4sleep11166899cyclictest00:28:121
203192840,0sleep320310-21sshd22:51:113
104592840,3sleep30-21swapper/300:10:473
70722810,2sleep10-21swapper/121:28:351
97502800,0sleep19743-21sshd22:59:291
96642800,3sleep30-21swapper/321:55:443
92812800,1sleep19282-21sshd22:50:131
117632800,2sleep31167799cyclictest22:32:113
21632790,1sleep02145-21sshd22:52:360
93442750,3sleep11166899cyclictest23:17:501
28612740,2sleep22860-21bash23:41:402
25402740,0sleep041ktimersoftd/022:28:150
46722720,1sleep20-21swapper/222:22:232
322572720,1sleep10-21swapper/122:40:111
322572720,1sleep10-21swapper/122:40:111
265152710,2sleep126509-21sshd22:39:381
159102710,1sleep31848-21nfsd20:30:113
82112700,3sleep01166099cyclictest22:59:210
138612680,0sleep03-21ksoftirqd/021:35:120
262102670,0sleep00-21swapper/021:48:190
10142670,3sleep11166899cyclictest21:49:001
217212640,0sleep31848-21nfsd22:02:573
186972630,2sleep01166099cyclictest22:20:380
1123025833,13sleep00-21swapper/019:07:220
278222510,4sleep11959-21sshd23:44:071
1027725033,12sleep20-21swapper/219:05:202
253842490,0sleep025383-21sshd21:21:140
324142440,0sleep132415-21bash22:49:201
39732430,2sleep23967-21bash00:39:282
281962400,2sleep328193-21sshd23:44:093
136332380,1sleep016739-21kworker/0:023:05:580
224672370,0sleep222466-21bash22:00:042
11670993317,2cyclictest33-21ksoftirqd/222:18:252
25192320,2sleep22511-21sshd21:55:112
206402320,0sleep320643-21sshd00:31:153
77682300,3sleep10-21swapper/122:07:401
1167099300,3cyclictest14795-21sshd23:18:212
11660993015,5cyclictest3-21ksoftirqd/000:28:370
11660993011,10cyclictest3-21ksoftirqd/000:05:160
83572290,4sleep21167099cyclictest21:46:362
77142290,2sleep10-21swapper/100:13:491
76392290,2sleep10-21swapper/122:16:381
1167099291,5cyclictest2912-21sshd21:25:142
11670992912,16cyclictest33-21ksoftirqd/200:17:022
11660992911,11cyclictest3-21ksoftirqd/021:27:440
211672280,3sleep11848-21nfsd00:21:351
211672280,3sleep11848-21nfsd00:21:341
17962280,4sleep20-21swapper/222:43:202
17962280,4sleep20-21swapper/222:43:202
11670992813,2cyclictest135650irq/27-eth000:31:012
11660992816,11cyclictest3-21ksoftirqd/022:08:520
1167099279,17cyclictest33-21ksoftirqd/223:22:312
1167099272,16cyclictest33-21ksoftirqd/223:10:562
11670992717,5cyclictest25-21rcuop/100:26:152
260342260,24sleep2135650irq/27-eth023:25:262
1167099265,18cyclictest33-21ksoftirqd/200:04:012
11670992612,7cyclictest1901-21nscd22:32:572
11668992621,3cyclictest0-21swapper/100:31:421
11660992614,6cyclictest3-21ksoftirqd/000:23:210
11660992614,6cyclictest3-21ksoftirqd/000:23:210
1166099260,24cyclictest10-21rcuc/023:51:280
108902260,1sleep010882-21sshd22:38:080
6892250,2sleep30-21swapper/323:07:543
1167099253,3cyclictest1846-21nfsd23:04:042
1167099253,20cyclictest33-21ksoftirqd/223:35:322
11660992514,9cyclictest3-21ksoftirqd/000:16:380
11660992510,9cyclictest3-21ksoftirqd/023:12:540
11670992412,5cyclictest33-21ksoftirqd/200:07:302
11660992413,4cyclictest3-21ksoftirqd/023:37:070
237592230,2sleep10-21swapper/100:09:011
1167099236,0cyclictest0-21swapper/222:47:372
1167099233,16cyclictest33-21ksoftirqd/222:35:512
1167099230,3cyclictest6000-21sshd00:23:212
1167099230,3cyclictest6000-21sshd00:23:212
1167099230,2cyclictest0-21swapper/222:12:092
1167099230,20cyclictest33-21ksoftirqd/222:27:542
1166099237,10cyclictest3-21ksoftirqd/023:27:400
1166099234,1cyclictest22222-21bash23:59:040
11660992311,5cyclictest3-21ksoftirqd/000:10:390
1166099230,16cyclictest22522-21sshd21:56:590
34992220,0sleep31847-21nfsd00:23:053
34992220,0sleep31847-21nfsd00:23:053
165122220,3sleep30-21swapper/321:41:203
11677992219,1cyclictest0-21swapper/300:19:193
11670992214,7cyclictest135650irq/27-eth022:55:252
11670992211,6cyclictest10950irq/23-ehci_hcd22:52:582
1167099220,20cyclictest33-21ksoftirqd/223:05:202
1167099220,20cyclictest33-21ksoftirqd/221:16:282
1166099223,4cyclictest10-21rcuc/023:24:550
11660992210,6cyclictest3-21ksoftirqd/021:42:060
1167099212,17cyclictest33-21ksoftirqd/221:51:352
1167099210,19cyclictest33-21ksoftirqd/221:31:172
11668992116,3cyclictest1848-21nfsd23:10:211
1166099214,13cyclictest0-21swapper/000:01:430
11660992117,2cyclictest3-21ksoftirqd/022:33:160
11677992012,5cyclictest22057-21sshd00:37:573
1167099208,4cyclictest135650irq/27-eth019:15:192
1167099200,19cyclictest33-21ksoftirqd/221:42:252
11668992012,4cyclictest22091-21bash22:20:581
1166099209,7cyclictest3-21ksoftirqd/022:14:370
11660992012,3cyclictest3-21ksoftirqd/023:19:530
11660992010,4cyclictest3-21ksoftirqd/023:01:430
165372190,1sleep20-21swapper/220:30:152
11677991915,3cyclictest1847-21nfsd23:10:203
11677991914,3cyclictest13345-21sshd23:21:133
11677991913,4cyclictest29600-21sshd23:35:003
1167099195,10cyclictest10950irq/23-ehci_hcd19:38:342
11668991914,4cyclictest21383-21cp23:28:051
11668991913,4cyclictest3315-21sshd23:08:091
1166099199,5cyclictest3-21ksoftirqd/021:53:040
11677991814,3cyclictest14590-21sshd21:50:153
11668991814,3cyclictest47-21rcuop/323:21:131
11668991814,2cyclictest1848-21nfsd23:33:111
1166099184,1cyclictest135650irq/27-eth021:30:300
11660991813,4cyclictest3-21ksoftirqd/022:41:350
11660991813,4cyclictest3-21ksoftirqd/022:41:340
11660991813,2cyclictest3-21ksoftirqd/022:46:510
11677991714,2cyclictest0-21swapper/322:28:513
11677991714,2cyclictest0-21swapper/322:07:493
11677991713,3cyclictest0-21swapper/323:19:103
11677991712,3cyclictest15766-21sshd23:45:583
1167799170,8cyclictest0-21swapper/323:33:173
1167799170,16cyclictest26915-21sshd21:30:233
1167099170,16cyclictest33-21ksoftirqd/221:35:022
1166899179,4cyclictest10950irq/23-ehci_hcd00:01:541
1166899176,2cyclictest30930-21sshd21:57:461
1166899176,10cyclictest17786-21sshd22:32:451
11668991713,2cyclictest1848-21nfsd23:00:481
11668991711,4cyclictest1848-21nfsd23:58:581
1166899170,15cyclictest0-21swapper/122:02:051
11660991712,4cyclictest3-21ksoftirqd/021:15:560
64142160,2sleep36403-21sshd21:46:263
1167799166,2cyclictest10950irq/23-ehci_hcd22:19:283
11677991613,2cyclictest8579-21sshd23:54:403
11677991612,3cyclictest22388-21tail19:30:223
11677991612,2cyclictest22092-21bash22:20:583
11677991611,3cyclictest24597-21sshd00:02:263
11677991611,2cyclictest1959-21sshd00:05:363
1167099160,14cyclictest0-21swapper/220:27:132
1166899164,5cyclictest144550irq/28-eth1-rx-00:37:431
11668991612,3cyclictest22389-21sed19:30:221
11677991512,2cyclictest0-21swapper/322:45:493
11677991511,3cyclictest9169-21id22:40:553
11677991511,3cyclictest9169-21id22:40:553
11677991511,2cyclictest15123-21sshd21:17:193
11677991510,4cyclictest1848-21nfsd21:29:123
11677991510,4cyclictest1848-21nfsd21:21:573
1167799150,14cyclictest0-21swapper/322:14:303
1167799150,12cyclictest26533-21rm00:25:213
11670991511,3cyclictest10950irq/23-ehci_hcd20:05:412
1166899153,3cyclictest26991-21id21:12:221
1166899153,11cyclictest13039-21sshd21:41:011
11668991511,2cyclictest0-21swapper/119:45:111
1166899150,14cyclictest3710-1kworker/1:1H20:25:141
1166899150,14cyclictest14549-21sshd21:20:151
1166099157,5cyclictest0-21swapper/020:14:150
11660991511,3cyclictest3-21ksoftirqd/020:30:140
1166099150,13cyclictest0-21swapper/019:38:060
11677991411,2cyclictest40872sleep320:03:513
11677991411,2cyclictest27969-21sed19:45:123
1167799140,6cyclictest3878-21sshd21:37:133
1167799140,13cyclictest1848-21nfsd22:58:483
1167799140,13cyclictest0-21swapper/320:52:213
1167099148,5cyclictest135650irq/27-eth019:29:252
1167099148,2cyclictest10950irq/23-ehci_hcd20:10:192
1167099148,2cyclictest10950irq/23-ehci_hcd19:50:152
1167099143,7cyclictest10950irq/23-ehci_hcd21:09:562
1167099141,9cyclictest0-21swapper/220:45:542
1167099141,12cyclictest135650irq/27-eth020:40:232
11670991411,1cyclictest0-21swapper/219:43:242
11670991410,3cyclictest10950irq/23-ehci_hcd20:35:182
11670991410,2cyclictest30264-21ipmi_fans21:00:172
1167099140,13cyclictest1848-21nfsd20:15:202
11668991411,2cyclictest1848-21nfsd22:26:301
11668991411,2cyclictest0-21swapper/120:03:521
1166899140,5cyclictest2405-21runrttasks19:42:461
1166899140,13cyclictest30409-21missed_timers21:00:191
1166899140,13cyclictest1915-21snmpd20:59:431
1166899140,13cyclictest0-21swapper/121:35:441
1166899140,12cyclictest7939-21sshd22:10:361
1166099147,4cyclictest0-21swapper/019:25:050
1166099140,11cyclictest0-21swapper/020:55:270
1166099140,11cyclictest0-21swapper/019:20:020
1167799137,5cyclictest0-21swapper/320:10:093
1167799136,6cyclictest0-21swapper/321:05:143
11677991311,1cyclictest0-21swapper/319:29:343
1167799130,5cyclictest0-21swapper/320:55:233
1167799130,12cyclictest15801-21runrttasks19:17:163
1167799130,12cyclictest0-21swapper/321:03:163
1167799130,12cyclictest0-21swapper/320:40:533
1167799130,12cyclictest0-21swapper/320:35:103
1167799130,12cyclictest0-21swapper/320:24:453
1167799130,12cyclictest0-21swapper/320:19:333
1167799130,12cyclictest0-21swapper/320:05:203
1167799130,12cyclictest0-21swapper/319:58:123
1167799130,12cyclictest0-21swapper/319:53:053
1167799130,12cyclictest0-21swapper/319:40:123
1167099138,3cyclictest13459-21taskset19:11:342
1167099137,5cyclictest47-21rcuop/319:55:152
1167099131,11cyclictest135650irq/27-eth020:20:262
11670991310,2cyclictest2899550switchtime19:45:202
1167099130,5cyclictest0-21swapper/219:32:172
1167099130,3cyclictest135650irq/27-eth020:55:582
1167099130,12cyclictest135650irq/27-eth020:00:042
1167099130,12cyclictest0-21swapper/220:50:422
1167099130,12cyclictest0-21swapper/219:22:202
1166899139,3cyclictest0-21swapper/119:25:431
1166899137,5cyclictest0-21swapper/120:37:281
1166899137,5cyclictest0-21swapper/120:21:431
11668991311,1cyclictest0-21swapper/120:51:361
1166899130,5cyclictest0-21swapper/119:52:231
1166899130,12cyclictest20995-21fschecks_time20:40:141
1166899130,12cyclictest1848-21nfsd20:47:281
1166899130,12cyclictest1848-21nfsd20:30:261
1166899130,12cyclictest0-21swapper/119:20:371
1166899130,12cyclictest0-21swapper/119:16:341
1166899130,11cyclictest32547-21iostat_ios21:05:161
1166899130,11cyclictest11974-21df19:10:131
1166099139,2cyclictest0-21swapper/019:10:170
1166099137,5cyclictest0-21swapper/020:51:500
1166099137,5cyclictest0-21swapper/020:35:020
1166099137,5cyclictest0-21swapper/020:15:140
1166099137,5cyclictest0-21swapper/019:53:370
1166099137,3cyclictest0-21swapper/020:01:000
1166099136,1cyclictest2405-21runrttasks19:15:560
11660991311,1cyclictest0-21swapper/021:05:070
1166099130,3cyclictest0-21swapper/020:05:550
1166099130,12cyclictest0-21swapper/020:40:460
1166099130,12cyclictest0-21swapper/019:30:140
1166099130,10cyclictest0-21swapper/020:46:070
1166099130,10cyclictest0-21swapper/020:21:250
1166099130,10cyclictest0-21swapper/019:46:190
1167799127,4cyclictest1893-21nscd20:25:213
1167799127,4cyclictest0-21swapper/320:45:173
1167799120,4cyclictest1848-21nfsd19:20:513
1167799120,11cyclictest23101-21munin-node19:35:133
1167799120,10cyclictest0-21swapper/319:10:123
1166899129,2cyclictest1848-21nfsd20:05:011
1166899127,4cyclictest0-21swapper/119:35:141
11668991210,1cyclictest0-21swapper/119:55:051
1166899120,3cyclictest10233-21cut20:15:211
1166899120,11cyclictest6966-21df20:10:141
1166099120,8cyclictest0-21swapper/019:55:140
1166099120,2cyclictest0-21swapper/020:27:000
1166099120,11cyclictest0-21swapper/021:02:300
1166099117,2cyclictest0-21swapper/019:40:350
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional