You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-28 - 09:46
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Fri Nov 28, 2025 00:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2500321620,2sleep124987-21sshd22:00:341
3108921500,3sleep20-21swapper/222:43:242
1658121500,2sleep00-21swapper/021:47:540
1150821420,4sleep1602899cyclictest23:33:211
87821410,2sleep20-21swapper/222:59:032
1107821300,2sleep30-21swapper/323:39:323
3210621290,0sleep00-21swapper/021:19:290
234521280,3sleep3603099cyclictest00:10:223
541921260,2sleep30-21swapper/321:13:583
1290121250,1sleep012899-21sshd00:35:000
911121240,2sleep2417-21jbd2/dm-0-821:11:092
2616121130,1sleep10-21swapper/122:15:421
2616121130,1sleep10-21swapper/122:15:411
2316621100,3sleep0602799cyclictest21:21:330
917921030,1sleep00-21swapper/023:58:170
198402990,4sleep2602999cyclictest23:03:562
566629733,43sleep10-21swapper/119:08:401
53972960,2sleep10-21swapper/122:22:501
305052960,0sleep11845-21nfsd22:46:191
208962960,1sleep10-21swapper/121:15:211
38542950,2sleep10-21swapper/100:20:221
373029534,48sleep30-21swapper/319:05:093
309402940,2sleep10-21swapper/123:23:071
11792940,1sleep10-21swapper/121:37:291
43232920,1sleep34318-21sshd00:34:033
164912900,3sleep20-21swapper/223:06:372
316222880,1sleep30-21swapper/322:01:123
144572880,2sleep30-21swapper/321:23:493
49072860,5sleep1602899cyclictest22:07:471
322202860,4sleep1602899cyclictest00:36:571
113342860,2sleep00-21swapper/021:56:200
320572840,4sleep1602899cyclictest23:14:101
31232830,2sleep30-21swapper/322:46:493
109572830,1sleep20-21swapper/223:33:182
68692820,2sleep36861-21sshd22:38:043
153552820,0sleep00-21swapper/022:38:530
248612810,1sleep20-21swapper/221:42:392
12862810,2sleep10-21swapper/123:51:041
103682810,2sleep10-21swapper/123:15:091
7052790,2sleep11848-21nfsd22:59:031
183642780,2sleep30-21swapper/321:39:083
124772780,1sleep012478-21bash22:14:320
82232770,1sleep08221-21sshd21:41:050
574127736,9sleep20-21swapper/219:09:372
34722770,0sleep00-21swapper/021:28:470
268902760,2sleep20-21swapper/223:22:452
316722750,1sleep30-21swapper/323:14:073
287842750,2sleep328781-21bash00:03:303
263672750,2sleep126358-21sshd00:12:541
283692730,3sleep3603099cyclictest23:19:533
258252680,0sleep225828-21bash23:59:592
21682670,3sleep3603099cyclictest21:34:393
111562650,0sleep211114-21sshd22:50:372
322972640,4sleep1602899cyclictest22:43:311
571925734,11sleep00-21swapper/019:09:190
151632570,1sleep10-21swapper/100:05:191
148982560,0sleep014889-21sshd22:02:410
238762530,5sleep30-21swapper/322:42:403
137672480,42sleep2135650irq/27-eth021:56:352
137182370,34sleep3135650irq/27-eth022:20:333
148122342,30sleep2135650irq/27-eth021:47:452
136952310,0sleep313694-21sshd22:17:353
136952310,0sleep313694-21sshd22:17:353
74122290,2sleep17404-21sshd23:26:551
6029992811,6cyclictest135650irq/27-eth023:44:272
232622280,2sleep223267-21sshd22:21:272
6030992721,1cyclictest32467-21sshd22:25:213
30712271,24sleep2135650irq/27-eth000:13:512
156292270,2sleep344-21ksoftirqd/323:24:453
6029992615,7cyclictest30755-21sshd23:14:022
602899269,16cyclictest22-21ksoftirqd/122:12:181
602899260,18cyclictest22-21ksoftirqd/122:37:331
254352260,24sleep3135650irq/27-eth023:34:443
109932260,3sleep30-21swapper/323:45:423
6030992510,6cyclictest1847-21nfsd23:09:333
254052250,3sleep20-21swapper/222:18:432
254052250,3sleep20-21swapper/222:18:432
138892250,2sleep30-21swapper/321:26:413
123022250,1sleep041ktimersoftd/022:53:560
602999242,13cyclictest26950irq/26-ahci[00022:34:352
6028992410,5cyclictest21181-21id21:57:171
602799241,13cyclictest1959-21sshd22:41:120
203252240,2sleep220324-21sshd00:28:492
6030992318,2cyclictest135650irq/27-eth023:55:213
6030992314,7cyclictest0-21swapper/323:03:003
6028992316,5cyclictest18545-21bash00:15:211
6028992315,6cyclictest1691-21kworker/1:023:39:401
602899231,19cyclictest22-21ksoftirqd/123:56:271
238642230,1sleep01848-21nfsd22:55:040
229542230,21sleep226950irq/26-ahci[00022:03:292
163152230,21sleep1135650irq/27-eth021:26:561
100012230,2sleep19997-21sshd23:45:351
603099226,10cyclictest14200-21bash22:05:333
6030992213,3cyclictest0-21swapper/321:15:313
6030992212,5cyclictest135650irq/27-eth000:06:193
6030992211,8cyclictest0-21swapper/322:54:223
602899224,6cyclictest11114-21sshd22:53:491
6028992216,3cyclictest18686-21bash23:40:151
6028992210,9cyclictest135650irq/27-eth023:02:281
164062220,2sleep20-21swapper/200:21:402
9962210,2sleep30-21swapper/321:55:233
602999217,5cyclictest10950irq/23-ehci_hcd22:06:162
602999215,5cyclictest10950irq/23-ehci_hcd19:50:212
6028992115,4cyclictest23002-21sshd22:30:251
6028992113,6cyclictest5690-21sshd23:08:411
6028992112,5cyclictest135650irq/27-eth021:50:431
6029992014,4cyclictest32722-21sshd00:07:052
6028992014,4cyclictest16846-21sshd22:29:581
6028992014,3cyclictest30544-21sshd21:31:111
6028992013,1cyclictest25-21rcuop/100:30:181
602799201,17cyclictest1066-21sshd22:46:380
300142200,18sleep1135650irq/27-eth021:13:131
286862200,3sleep10-21swapper/121:49:041
100502200,2sleep210047-21rm22:14:182
603099194,9cyclictest1893-21nscd00:23:233
6030991913,4cyclictest10630-21bash22:32:233
6030991911,3cyclictest3559-21bash23:26:333
603099190,18cyclictest44-21ksoftirqd/321:46:473
603099190,12cyclictest8435-21sshd22:56:373
602999193,8cyclictest13141-21sshd22:47:472
6029991917,1cyclictest0-21swapper/220:51:532
602999190,15cyclictest0-21swapper/222:35:542
6028991915,2cyclictest30502-21sshd21:22:151
6028991914,4cyclictest18651-21sshd00:02:251
602799190,18cyclictest1848-21nfsd00:21:560
602799190,13cyclictest0-21swapper/023:31:200
6030991812,4cyclictest16011-21sshd21:41:503
602999187,10cyclictest0-21swapper/223:19:162
602999181,4cyclictest16340-21bash00:02:112
6029991814,3cyclictest12778-21sshd23:39:422
6029991810,2cyclictest10950irq/23-ehci_hcd23:26:412
6028991814,2cyclictest0-21swapper/100:27:141
602799180,16cyclictest1848-21nfsd23:19:190
602799180,16cyclictest0-21swapper/021:38:170
602799180,12cyclictest14573-21sshd23:21:320
602799180,11cyclictest15826-21sshd21:14:590
158182180,3sleep00-21swapper/000:05:220
6030991714,1cyclictest0-21swapper/300:28:053
6030991711,3cyclictest7177-21sshd22:14:013
6030991711,3cyclictest25388-21sshd23:40:483
603099170,3cyclictest30795-21sshd23:50:473
603099170,10cyclictest1935-21sshd21:52:313
602999175,7cyclictest9071-21diskstats21:35:152
602999174,8cyclictest4323-21sshd23:51:242
602999174,1cyclictest27235-21sh19:55:142
6028991713,3cyclictest25047-21iostat_ios19:50:181
105222170,15sleep1135650irq/27-eth021:41:191
603099164,0cyclictest0-21swapper/300:16:193
603099160,7cyclictest1576-21avahi-daemon19:14:233
602999169,2cyclictest10950irq/23-ehci_hcd00:31:222
602999164,7cyclictest13593-21ntp_states20:35:192
602999162,12cyclictest30671-21sshd21:31:122
6029991613,2cyclictest1848-21nfsd21:22:082
6029991612,3cyclictest1228-21users21:25:292
6029991610,5cyclictest31184-21sshd22:25:142
602799167,8cyclictest19189-21sshd23:25:050
6027991612,2cyclictest1544-21sshd23:11:140
602799161,14cyclictest10809-21sshd23:52:030
602799161,11cyclictest26575-21sshd21:54:520
602799160,15cyclictest0-21swapper/023:45:180
602799160,15cyclictest0-21swapper/023:02:460
602799160,14cyclictest0-21swapper/023:08:290
602799160,12cyclictest0-21swapper/000:16:510
603099152,1cyclictest16999-21nfsd400:35:213
603099150,13cyclictest0-21swapper/320:35:123
602999157,3cyclictest6529-21bash00:17:252
602999152,12cyclictest26950irq/26-ahci[00021:54:202
6029991511,3cyclictest18360-21sshd23:46:262
602999151,12cyclictest27275-21sshd21:15:562
602999150,13cyclictest0-21swapper/200:35:062
602899150,8cyclictest0-21swapper/119:10:141
602799159,1cyclictest19143-21rm22:33:110
602799157,7cyclictest0-21swapper/020:20:260
602799156,4cyclictest24212-21sshd23:43:560
602799153,2cyclictest20600-21sshd22:06:100
602799150,1cyclictest26452-21bash22:21:460
602799150,1cyclictest0-21swapper/021:05:160
602799150,14cyclictest0-21swapper/021:30:000
602799150,14cyclictest0-21swapper/000:39:010
602799150,14cyclictest0-21swapper/000:02:180
602799150,13cyclictest0-21swapper/022:15:020
602799150,13cyclictest0-21swapper/022:15:010
603099149,1cyclictest23846-21munin-node21:00:293
6030991410,3cyclictest10950irq/23-ehci_hcd19:51:273
603099140,6cyclictest0-21swapper/320:40:333
603099140,6cyclictest0-21swapper/320:20:193
602999144,1cyclictest0-21swapper/221:05:552
6029991410,3cyclictest10494-21df_inode20:30:132
602999140,12cyclictest30680-21sshd20:02:302
602899148,5cyclictest9286-21nscd20:45:151
602899148,1cyclictest135650irq/27-eth020:50:251
602899147,6cyclictest14996-21df20:40:121
602899141,12cyclictest135650irq/27-eth019:46:221
602899140,5cyclictest2405-21runrttasks19:18:151
602899140,5cyclictest0-21swapper/120:10:221
602799146,5cyclictest0-21swapper/020:40:060
602799140,1cyclictest0-21swapper/022:26:410
602799140,13cyclictest0-21swapper/019:35:470
602799140,12cyclictest0-21swapper/000:27:520
602799140,11cyclictest0-21swapper/020:58:470
602799140,11cyclictest0-21swapper/020:10:370
602799140,10cyclictest1846-21nfsd00:10:030
603099138,4cyclictest26950irq/26-ahci[00020:25:443
603099137,5cyclictest23137-21ntpq19:45:173
603099137,5cyclictest0-21swapper/319:44:013
603099136,6cyclictest0-21swapper/320:55:133
603099130,5cyclictest0-21swapper/320:15:213
603099130,5cyclictest0-21swapper/319:15:173
603099130,12cyclictest0-21swapper/320:50:313
603099130,12cyclictest0-21swapper/320:31:213
603099130,12cyclictest0-21swapper/320:10:133
603099130,12cyclictest0-21swapper/320:04:343
603099130,12cyclictest0-21swapper/319:56:393
603099130,12cyclictest0-21swapper/319:36:073
603099130,12cyclictest0-21swapper/319:30:193
603099130,12cyclictest0-21swapper/319:25:053
603099130,10cyclictest10950irq/23-ehci_hcd20:45:033
602999137,5cyclictest0-21swapper/219:43:562
602999136,3cyclictest10950irq/23-ehci_hcd20:05:142
602999131,3cyclictest8999-21hddtemp_smartct19:15:152
602999131,11cyclictest135650irq/27-eth020:25:592
602999130,5cyclictest0-21swapper/221:03:342
602999130,12cyclictest0-21swapper/220:47:422
602999130,12cyclictest0-21swapper/219:45:342
602999130,12cyclictest0-21swapper/219:39:142
602999130,12cyclictest0-21swapper/219:26:302
602999130,12cyclictest0-21swapper/219:20:082
602999130,12cyclictest0-21swapper/219:12:092
602999130,11cyclictest21882-21df_inode20:55:132
602999130,10cyclictest135650irq/27-eth020:18:582
602899138,4cyclictest0-21swapper/121:00:261
602899137,4cyclictest13881-21munin-node19:25:181
602899134,4cyclictest10950irq/23-ehci_hcd19:20:191
602899131,11cyclictest0-21swapper/120:25:141
602899130,12cyclictest0-21swapper/120:55:261
602899130,12cyclictest0-21swapper/120:39:501
602899130,12cyclictest0-21swapper/119:39:321
602899130,11cyclictest3993-21hddtemp_smartct20:15:141
602899130,11cyclictest27332-21irqstats19:55:151
602899130,11cyclictest26803-21hddtemp_smartct21:05:161
602899130,11cyclictest20480-21iostat19:40:151
602899130,11cyclictest10935-21iostat_ios20:30:161
602899130,11cyclictest0-21swapper/120:05:141
602799137,5cyclictest0-21swapper/020:07:170
602799137,5cyclictest0-21swapper/019:48:030
602799137,5cyclictest0-21swapper/019:25:450
602799136,3cyclictest2329-21sshd23:35:270
602799132,10cyclictest0-21swapper/020:36:560
602799130,9cyclictest0-21swapper/021:00:160
602799130,12cyclictest0-21swapper/020:53:030
602799130,12cyclictest0-21swapper/020:33:540
602799130,12cyclictest0-21swapper/020:28:450
602799130,12cyclictest0-21swapper/020:02:210
602799130,12cyclictest0-21swapper/019:52:360
602799130,12cyclictest0-21swapper/019:40:430
602799130,12cyclictest0-21swapper/019:35:000
603099120,11cyclictest0-21swapper/321:08:413
603099120,11cyclictest0-21swapper/320:08:193
603099120,11cyclictest0-21swapper/319:21:333
602999127,3cyclictest15049-21df_inode20:40:132
602999120,4cyclictest1688-21munin-node20:10:152
602999120,11cyclictest1848-21nfsd20:20:142
602999120,11cyclictest0-21swapper/219:30:342
602899127,4cyclictest28975-21cpu20:00:111
602899120,4cyclictest0-21swapper/120:20:181
602899120,10cyclictest0-21swapper/119:30:121
602799127,4cyclictest0-21swapper/019:17:180
602799120,2cyclictest0-21swapper/019:55:250
602799120,1cyclictest0-21swapper/019:24:110
602799120,11cyclictest0-21swapper/020:45:580
602799120,11cyclictest0-21swapper/020:15:360
602799120,10cyclictest0-21swapper/019:10:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional