You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-17 - 06:14
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Wed Sep 17, 2025 00:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
416921810,4sleep22349699cyclictest21:33:372
1801521380,3sleep02349499cyclictest00:32:270
1835121370,1sleep20-21swapper/223:54:502
1123121350,3sleep30-21swapper/323:50:503
671521320,3sleep20-21swapper/222:22:552
1772421320,1sleep10-21swapper/100:07:391
2536221300,1sleep30-21swapper/322:30:423
192421240,2sleep20-21swapper/221:18:102
2081421230,4sleep22349699cyclictest00:29:092
1006121210,4sleep22349699cyclictest23:07:002
1547521160,3sleep22349699cyclictest21:10:122
783321140,1sleep20-21swapper/221:55:182
2878621110,7sleep10-21swapper/121:54:161
1008321080,1sleep00-21swapper/023:22:360
2528921040,2sleep00-21swapper/021:50:470
23084210432,43sleep10-21swapper/119:08:021
284532940,1sleep31848-21nfsd22:59:283
43862910,1sleep00-21swapper/023:47:020
205702900,4sleep32349799cyclictest21:50:223
289792880,2sleep128967-21sshd21:20:371
139742870,1sleep10-21swapper/123:54:251
87712860,2sleep22349699cyclictest00:03:242
224742860,1sleep041ktimersoftd/023:11:190
168142860,0sleep00-21swapper/022:23:520
174072840,2sleep117405-21sshd00:14:291
37012810,1sleep20-21swapper/223:59:432
2313828134,43sleep30-21swapper/319:08:453
74772800,1sleep10-21swapper/123:22:221
73802790,2sleep27378-21sshd21:43:032
212382780,2sleep321237-21sshd23:55:073
69772770,1sleep30-21swapper/321:15:293
138612770,4sleep313862-21sshd00:31:583
48932760,1sleep02349499cyclictest22:44:250
48702750,2sleep14863-21sshd22:25:431
54822740,2sleep25483-21sshd23:40:432
322562740,2sleep332257-21bash23:40:163
278882740,2sleep327883-21sshd22:43:273
4432730,1sleep20-21swapper/221:45:232
38772730,1sleep10-21swapper/122:34:571
178942720,0sleep117891-21sshd22:14:471
280692700,2sleep10-21swapper/123:30:281
273692700,1sleep00-21swapper/023:55:360
242472700,1sleep00-21swapper/021:26:180
161212700,2sleep20-21swapper/223:16:582
201792670,2sleep30-21swapper/323:01:433
157672650,2sleep315763-21cp00:39:363
312852610,0sleep00-21swapper/000:05:380
2314725833,13sleep00-21swapper/019:08:500
2315425532,10sleep20-21swapper/219:08:562
156142540,3sleep03-21ksoftirqd/022:32:550
199682450,1sleep10-21swapper/121:47:151
252972350,3sleep20-21swapper/223:33:222
236472340,2sleep323639-21cp23:23:563
23494993410,14cyclictest3-21ksoftirqd/000:12:350
177762330,2sleep117764-21sshd21:19:411
321292320,2sleep10-21swapper/123:43:271
2349499320,1cyclictest17999-21sshd21:10:210
23494993025,4cyclictest0-21swapper/023:15:170
223962300,28sleep2135650irq/27-eth023:39:202
23494992914,8cyclictest3-21ksoftirqd/022:03:220
121622290,0sleep012163-21bash23:38:170
78752280,2sleep17867-21sshd23:06:471
73782280,4sleep30-21swapper/323:37:473
66062280,1sleep00-21swapper/023:28:310
295672280,2sleep10-21swapper/123:27:351
2349499289,10cyclictest32222-21sshd00:26:410
23494992814,3cyclictest10264-21cat19:50:170
2349699270,19cyclictest33-21ksoftirqd/223:00:282
23494992714,6cyclictest3-21ksoftirqd/021:55:520
23494992714,10cyclictest3-21ksoftirqd/021:40:580
23494992712,5cyclictest3-21ksoftirqd/000:22:280
23494992615,4cyclictest3-21ksoftirqd/022:18:170
23494992613,4cyclictest3-21ksoftirqd/022:28:560
2349499260,22cyclictest26910-21sshd22:06:240
304332250,2sleep230431-21sshd21:20:462
245152250,2sleep11848-21nfsd22:55:491
23496992515,5cyclictest10950irq/23-ehci_hcd22:36:132
23494992515,3cyclictest3-21ksoftirqd/021:33:080
23494992514,7cyclictest3-21ksoftirqd/021:39:590
23494992514,7cyclictest3-21ksoftirqd/021:39:580
23494992513,11cyclictest3-21ksoftirqd/021:16:030
2349499250,16cyclictest26884-21sshd00:01:520
258752240,21sleep2135650irq/27-eth023:49:142
23496992421,2cyclictest17376-21sshd00:21:182
2349499249,7cyclictest3-21ksoftirqd/023:44:070
2349499243,13cyclictest31026-21sshd22:53:230
2349499240,15cyclictest0-21swapper/022:11:460
173192240,5sleep30-21swapper/322:48:493
244402230,2sleep30-21swapper/321:38:353
244402230,2sleep30-21swapper/321:38:343
2349499239,13cyclictest3-21ksoftirqd/021:22:130
23494992315,2cyclictest3-21ksoftirqd/023:50:290
23494992313,5cyclictest3-21ksoftirqd/022:56:070
23494992313,4cyclictest3-21ksoftirqd/023:08:510
23494992311,3cyclictest9094-21bash21:49:210
23496992215,4cyclictest20442-21sshd22:52:162
23494992212,3cyclictest3-21ksoftirqd/022:39:010
2349499220,12cyclictest0-21swapper/023:03:120
23497992116,4cyclictest22967-21id21:32:193
2349699211,8cyclictest10950irq/23-ehci_hcd21:51:062
23496992114,2cyclictest10950irq/23-ehci_hcd22:04:012
23496992110,5cyclictest10950irq/23-ehci_hcd22:30:352
23494992115,4cyclictest3-21ksoftirqd/000:36:110
23494992111,1cyclictest0-21swapper/023:30:050
23497992012,4cyclictest1959-21sshd21:12:523
2349699206,7cyclictest1959-21sshd00:19:482
2349699206,6cyclictest19847-21sshd22:11:512
23496992015,4cyclictest31956-21sadc20:40:002
23496992012,2cyclictest10950irq/23-ehci_hcd22:46:532
2349799195,13cyclictest9784-21bash23:19:323
2349799194,12cyclictest13023-21sshd00:10:273
23497991915,3cyclictest22423-21bash21:47:303
23497991914,3cyclictest8505-21sshd21:40:083
23497991913,4cyclictest30104-21sshd00:26:253
2349699198,4cyclictest24519-21bash21:26:182
2349699193,3cyclictest27578-21sshd22:15:352
2349699191,8cyclictest31508-21sshd00:33:582
2349699191,5cyclictest28936-21sshd23:27:322
2349699190,9cyclictest36-21rcuop/200:39:422
2349699190,18cyclictest33-21ksoftirqd/222:09:352
2349599196,5cyclictest10950irq/23-ehci_hcd23:36:581
2349599192,4cyclictest0-21swapper/100:33:091
2349599191,7cyclictest32338-21sshd23:46:361
23495991913,5cyclictest19374-21bash21:31:561
2349599191,16cyclictest197472sleep100:25:201
23494991914,2cyclictest3-21ksoftirqd/000:16:100
23494991910,2cyclictest26727-21bash22:46:290
172392190,3sleep10-21swapper/100:35:531
9202180,16sleep1135650irq/27-eth022:22:231
61912180,2sleep30-21swapper/319:40:213
6022180,8sleep30-21swapper/323:34:073
28822181,13sleep2135650irq/27-eth022:56:552
2349799188,7cyclictest19367-21sshd00:21:303
23497991814,3cyclictest27838-21sshd23:08:473
23497991812,5cyclictest4687-21bash22:35:013
23497991810,4cyclictest27724-21rm22:03:193
2349699188,2cyclictest10950irq/23-ehci_hcd23:20:382
2349699187,3cyclictest9117-21sshd00:06:432
2349699186,10cyclictest135650irq/27-eth000:12:082
2349699184,10cyclictest10950irq/23-ehci_hcd19:39:422
23496991812,5cyclictest1848-21nfsd21:35:202
23496991812,5cyclictest1848-21nfsd21:35:202
23496991811,5cyclictest0-21swapper/223:11:302
2349699180,14cyclictest10104-21sshd22:26:122
2349599189,3cyclictest1848-21nfsd19:21:581
2349599184,4cyclictest144550irq/28-eth1-rx-00:24:321
2349599182,5cyclictest23696-21sshd22:09:131
2349599181,6cyclictest31419-21sshd22:40:331
23495991814,2cyclictest0-21swapper/123:10:301
23495991813,4cyclictest32711-21sshd23:59:221
23495991811,6cyclictest10950irq/23-ehci_hcd22:35:011
2349799178,8cyclictest0-21swapper/323:27:013
2349799174,12cyclictest6350-21sshd23:47:153
23497991713,3cyclictest13906-21sshd22:05:083
23497991712,4cyclictest9932-21sshd00:06:493
23497991712,3cyclictest7419-21sshd22:25:583
23497991712,3cyclictest27872-21bash22:21:493
23497991712,3cyclictest1845-21nfsd23:12:033
23497991711,4cyclictest958-21sshd22:16:093
2349699173,3cyclictest3618-21sshd22:44:162
2349599176,7cyclictest2231-21sshd21:39:341
2349599176,7cyclictest2231-21sshd21:39:331
2349599171,4cyclictest20556-21sshd21:13:491
23495991711,4cyclictest20882-21bash22:45:531
2349799166,7cyclictest1959-21sshd00:16:443
23497991614,1cyclictest1848-21nfsd22:10:583
2349599162,12cyclictest7434-21sshd23:00:261
2349599162,12cyclictest17791-21bash21:25:401
23495991613,2cyclictest20673-21sshd21:56:291
23495991613,2cyclictest0-21swapper/121:40:091
2349599161,2cyclictest0-21swapper/100:15:181
2349599161,14cyclictest0-21swapper/123:15:521
2349599161,13cyclictest1845-21nfsd22:19:551
2349599161,10cyclictest2990-21sshd22:50:281
23495991610,4cyclictest2292-21sshd22:00:511
2349499164,8cyclictest0-21swapper/019:30:200
2349499161,2cyclictest8-21rcu_preempt20:10:200
2349799152,12cyclictest0-21swapper/321:27:453
2349799151,12cyclictest7623-21sshd21:55:163
23497991510,4cyclictest10137-21sshd00:03:333
23497991510,3cyclictest14943-21sshd21:22:243
23497991510,3cyclictest0-21swapper/319:53:133
2349799150,6cyclictest0-21swapper/320:50:173
2349799150,13cyclictest0-21swapper/322:51:333
2349699157,4cyclictest10950irq/23-ehci_hcd20:25:132
2349699153,11cyclictest10950irq/23-ehci_hcd19:23:522
23495991512,2cyclictest23238-21sshd00:01:311
2349599150,14cyclictest0-21swapper/120:25:501
2349499157,6cyclictest0-21swapper/019:19:310
2349499157,5cyclictest0-21swapper/020:20:230
2349499156,8cyclictest0-21swapper/020:16:490
2349499152,7cyclictest0-21swapper/019:25:200
2349499150,14cyclictest0-21swapper/020:01:200
23497991412,1cyclictest0-21swapper/320:41:273
2349799140,13cyclictest0-21swapper/320:20:123
2349799140,13cyclictest0-21swapper/320:16:563
2349799140,13cyclictest0-21swapper/320:07:413
2349699144,2cyclictest0-21swapper/219:56:542
2349699142,11cyclictest135650irq/27-eth019:47:322
23496991412,1cyclictest0-21swapper/220:20:012
2349699141,1cyclictest0-21swapper/220:51:122
23496991410,3cyclictest10950irq/23-ehci_hcd19:27:512
2349699140,2cyclictest1131-21jbd2/dm-2-821:00:102
2349699140,13cyclictest0-21swapper/219:17:192
2349699140,10cyclictest27952-21diskstats20:30:122
2349599148,5cyclictest32080-21taskset19:26:211
2349599148,5cyclictest1927-21snmpd19:48:461
2349599148,5cyclictest0-21swapper/120:15:551
2349599148,5cyclictest0-21swapper/120:12:591
2349599148,5cyclictest0-21swapper/120:09:221
2349599148,5cyclictest0-21swapper/119:40:281
23495991412,1cyclictest0-21swapper/121:00:171
2349599140,13cyclictest0-21swapper/119:56:311
2349799137,5cyclictest0-21swapper/319:30:433
2349799130,5cyclictest0-21swapper/320:31:033
2349799130,4cyclictest9810-21memory21:00:193
2349799130,4cyclictest8730-21users19:45:233
2349799130,12cyclictest1848-21nfsd19:56:323
2349799130,12cyclictest0-21swapper/320:45:033
2349799130,12cyclictest0-21swapper/320:35:503
2349799130,12cyclictest0-21swapper/320:00:403
2349799130,12cyclictest0-21swapper/319:25:333
2349799130,12cyclictest0-21swapper/319:20:443
2349799130,11cyclictest26058-21df19:15:143
2349799130,11cyclictest26020-21hddtemp_smartct20:25:163
2349799130,11cyclictest18765-21df20:10:123
2349699139,2cyclictest0-21swapper/220:10:122
2349699133,2cyclictest0-21swapper/221:08:532
2349699132,3cyclictest135650irq/27-eth019:40:342
2349699131,10cyclictest7406-21munin-node20:55:172
2349699130,12cyclictest0-21swapper/220:46:482
2349699130,12cyclictest0-21swapper/220:01:332
2349699130,12cyclictest0-21swapper/219:53:452
2349699130,12cyclictest0-21swapper/219:30:492
2349699130,12cyclictest0-21swapper/219:10:232
2349599138,4cyclictest23996-21fschecks_time19:10:141
2349599138,4cyclictest0-21swapper/120:40:481
2349599138,4cyclictest0-21swapper/120:00:121
2349599138,4cyclictest0-21swapper/119:37:141
2349599131,11cyclictest36-21rcuop/219:30:091
2349599130,12cyclictest2405-21runrttasks20:45:421
2349599130,12cyclictest0-21swapper/121:05:541
2349599130,12cyclictest0-21swapper/120:58:161
2349599130,12cyclictest0-21swapper/120:51:531
2349599130,12cyclictest0-21swapper/120:35:181
2349599130,12cyclictest0-21swapper/120:30:051
2349599130,12cyclictest0-21swapper/119:50:051
2349599130,12cyclictest0-21swapper/119:16:241
2349599130,11cyclictest23388-21diskstats20:20:131
2349499139,1cyclictest0-21swapper/020:55:270
2349499137,5cyclictest16223-21munin-node20:05:240
2349499137,5cyclictest0-21swapper/020:36:170
2349499137,4cyclictest0-21swapper/019:37:520
2349499134,7cyclictest0-21swapper/020:54:130
2349499130,1cyclictest0-21swapper/021:05:190
2349499130,1cyclictest0-21swapper/020:47:290
2349499130,1cyclictest0-21swapper/019:23:000
2349499130,12cyclictest28891-21munin-node20:30:200
2349499130,12cyclictest0-21swapper/021:00:030
2349799120,3cyclictest23782-21df19:10:133
2349799120,11cyclictest3303-21iostat_ios19:35:183
2349799120,10cyclictest6646-21munin-node20:55:123
2349799120,10cyclictest11890-21hddtemp_smartct21:05:153
2349699125,6cyclictest0-21swapper/220:40:232
23496991210,1cyclictest0-21swapper/220:20:332
2349699120,11cyclictest10950irq/23-ehci_hcd20:05:372
2349499120,8cyclictest0-21swapper/020:40:130
2349499120,2cyclictest0-21swapper/019:55:090
2349499120,1cyclictest0-21swapper/020:26:150
2349499120,11cyclictest0-21swapper/019:45:300
2349499120,11cyclictest0-21swapper/019:40:060
2349499110,2cyclictest0-21swapper/019:10:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional