You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-10 - 14:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Wed Dec 10, 2025 12:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
533121880,1sleep2562899cyclictest09:32:132
917421620,4sleep0562099cyclictest09:53:220
2871121380,2sleep10-21swapper/111:44:301
1728921350,0sleep317288-21sshd11:22:593
446721230,5sleep10-21swapper/107:05:181
1457021180,2sleep10-21swapper/111:36:041
2832121150,2sleep128310-21sshd10:09:271
738221040,2sleep30-21swapper/311:00:473
231521040,2sleep22313-21sshd12:12:412
310221000,1sleep10-21swapper/112:26:181
260382980,0sleep00-21swapper/010:59:200
42222970,1sleep10-21swapper/111:18:081
503429333,48sleep30-21swapper/307:06:063
100322920,3sleep30-21swapper/311:25:293
307112910,0sleep00-21swapper/011:48:010
265342910,1sleep026520-21sshd12:15:190
24812890,2sleep10-21swapper/109:52:401
80082880,5sleep0562099cyclictest09:56:360
300662880,1sleep030060-21sshd11:58:160
115622880,1sleep08-21rcu_preempt09:39:570
98522870,0sleep00-21swapper/012:06:300
216232870,3sleep1562599cyclictest12:31:321
95402850,1sleep31847-21nfsd12:33:423
19822850,2sleep31966-21sshd09:38:503
320412830,1sleep20-21swapper/211:24:312
131462830,1sleep20-21swapper/211:46:082
251912820,5sleep20-21swapper/207:50:242
510828132,11sleep20-21swapper/207:07:012
208472810,0sleep00-21swapper/011:13:030
318442800,3sleep231832-21sshd12:15:502
299362800,1sleep029934-21sshd11:37:480
301812790,1sleep30-21swapper/310:16:343
88372770,2sleep38840-21sshd10:21:163
321502760,4sleep3562999cyclictest12:12:213
156542760,4sleep3562999cyclictest10:46:333
52362750,1sleep10-21swapper/112:05:591
58492730,1sleep35848-21sshd09:21:483
97192710,2sleep10-21swapper/112:03:021
76462710,1sleep20-21swapper/209:56:342
309502700,0sleep00-21swapper/011:03:320
121022700,4sleep0562099cyclictest09:19:010
295022690,4sleep3562999cyclictest09:31:173
18922690,2sleep11889-21sshd10:45:111
229172680,2sleep30-21swapper/310:26:293
80212630,2sleep10-21swapper/109:25:341
223292570,2sleep222320-21sshd10:12:132
284642550,0sleep00-21swapper/009:41:370
132062490,2sleep10-21swapper/111:32:361
506724335,4sleep00-21swapper/007:06:300
144552400,3sleep10-21swapper/111:22:421
562599358,21cyclictest22-21ksoftirqd/112:14:051
246322350,3sleep30-21swapper/311:50:463
36132340,30sleep1135650irq/27-eth009:42:271
5620993318,14cyclictest41ktimersoftd/009:48:570
562099331,29cyclictest0-21swapper/010:45:370
193422320,29sleep1135650irq/27-eth009:33:451
133642320,3sleep30-21swapper/309:50:173
124512320,2sleep10-21swapper/108:35:131
5620993016,13cyclictest3-21ksoftirqd/011:53:070
5620993013,3cyclictest3-21ksoftirqd/012:27:130
562099293,23cyclictest10883-21sshd11:15:210
562099293,18cyclictest1959-21sshd11:34:350
562099292,24cyclictest8-21rcu_preempt10:08:040
562099290,23cyclictest0-21swapper/012:21:320
179262290,2sleep20-21swapper/209:19:382
90722280,26sleep3135650irq/27-eth009:56:433
562599280,19cyclictest22-21ksoftirqd/111:26:111
562099289,16cyclictest3-21ksoftirqd/012:32:450
5620992815,11cyclictest3-21ksoftirqd/012:37:530
5620992812,7cyclictest3-21ksoftirqd/010:17:100
562099281,19cyclictest16743-21sshd11:26:110
5620992811,15cyclictest3-21ksoftirqd/012:01:480
562099279,16cyclictest3-21ksoftirqd/011:22:220
562099279,16cyclictest3-21ksoftirqd/010:34:310
562099279,16cyclictest1848-21nfsd09:20:400
562099272,12cyclictest7836-21sshd11:08:120
5620992714,12cyclictest3-21ksoftirqd/011:40:060
562099271,24cyclictest41ktimersoftd/009:25:020
5620992712,14cyclictest3-21ksoftirqd/009:34:380
562099270,24cyclictest0-21swapper/012:12:310
174472270,4sleep1562599cyclictest10:04:471
106342270,0sleep224467-21kworker/2:110:39:102
562099269,16cyclictest3-21ksoftirqd/010:50:090
562099263,14cyclictest1845-21nfsd10:13:550
562099261,24cyclictest8216-21sshd10:21:120
228922260,2sleep30-21swapper/309:13:053
562599258,14cyclictest22-21ksoftirqd/112:19:171
562599255,17cyclictest22-21ksoftirqd/109:20:031
562599251,9cyclictest21528-21sshd10:43:491
5620992515,8cyclictest3-21ksoftirqd/009:10:180
5620992514,10cyclictest3-21ksoftirqd/010:03:080
232802250,23sleep3135650irq/27-eth011:33:433
121872250,1sleep212176-21sshd10:42:502
5629992416,5cyclictest5108-21bash11:07:513
5628992414,3cyclictest10950irq/23-ehci_hcd12:20:562
5628992410,6cyclictest19978-21sshd09:40:422
5625992411,4cyclictest22-21ksoftirqd/111:12:531
562599240,16cyclictest22-21ksoftirqd/111:06:091
562099241,21cyclictest10-21rcuc/010:25:360
562099240,15cyclictest9365-21sshd10:42:330
325852240,2sleep20-21swapper/211:31:132
253922240,2sleep31847-21nfsd12:38:383
5625992311,4cyclictest3717-21sshd09:56:081
562599230,19cyclictest22-21ksoftirqd/109:10:171
210202230,21sleep1135650irq/27-eth010:26:161
101802230,2sleep110181-21bash11:49:191
562999226,7cyclictest135650irq/27-eth011:55:453
562599228,11cyclictest135650irq/27-eth011:55:271
562599224,3cyclictest10510-21bash11:01:091
562599221,18cyclictest22-21ksoftirqd/109:37:221
562599220,19cyclictest22-21ksoftirqd/110:55:421
562599220,17cyclictest22-21ksoftirqd/110:22:051
263522220,1sleep20-21swapper/210:02:062
215922220,4sleep30-21swapper/312:25:003
562999216,5cyclictest135650irq/27-eth009:49:573
5629992116,4cyclictest0-21swapper/310:59:513
5629992110,2cyclictest135650irq/27-eth011:19:483
562899212,14cyclictest1959-21sshd12:32:212
562899212,11cyclictest135650irq/27-eth012:04:032
5628992112,6cyclictest20439-21sshd10:58:402
562599219,6cyclictest135650irq/27-eth012:21:321
562599218,2cyclictest29118-21rm09:17:141
562599217,3cyclictest135650irq/27-eth009:49:041
562599213,6cyclictest3730-21bash11:52:021
562599211,18cyclictest22-21ksoftirqd/110:16:191
562599210,19cyclictest22-21ksoftirqd/110:10:371
5620992115,5cyclictest3-21ksoftirqd/010:37:310
562099210,20cyclictest0-21swapper/008:41:390
208942210,3sleep2562899cyclictest09:37:262
149262210,2sleep30-21swapper/309:40:163
562999207,6cyclictest1959-21sshd12:15:063
5629992016,3cyclictest1959-21sshd10:37:593
562999201,16cyclictest0-21swapper/311:43:373
5629992011,2cyclictest10950irq/23-ehci_hcd12:22:233
562899208,6cyclictest135650irq/27-eth011:26:322
5628992014,5cyclictest1848-21nfsd11:53:152
5628992013,4cyclictest6493-21bash09:46:052
5628992012,5cyclictest1848-21nfsd11:19:482
562599200,18cyclictest22-21ksoftirqd/110:53:381
317142200,1sleep231713-21sshd11:55:042
104582200,0sleep30-21swapper/310:42:403
562999195,5cyclictest26704-21sshd12:01:143
562999194,12cyclictest0-21swapper/309:17:493
562899197,6cyclictest10950irq/23-ehci_hcd10:20:172
562899196,5cyclictest10950irq/23-ehci_hcd10:06:502
5628991915,2cyclictest0-21swapper/212:07:332
5628991913,4cyclictest4182-21sshd10:45:192
5628991913,4cyclictest25884-21bash11:40:372
5628991912,4cyclictest135650irq/27-eth011:00:292
562599193,1cyclictest23017-21bash12:35:051
5625991912,5cyclictest13866-21cp10:32:271
562599190,17cyclictest22-21ksoftirqd/110:37:521
562099190,3cyclictest0-21swapper/009:00:170
211032190,17sleep2135650irq/27-eth011:05:532
562999189,7cyclictest1847-21nfsd10:12:123
562999187,3cyclictest26461-21sshd11:37:263
562999185,5cyclictest135650irq/27-eth011:11:203
5629991813,3cyclictest24489-21sshd09:27:243
5629991812,4cyclictest32717-21bash12:05:253
562899186,5cyclictest0-21swapper/212:27:192
5628991815,2cyclictest24061-21ipmi_fans09:20:152
5628991813,1cyclictest10950irq/23-ehci_hcd11:14:172
5628991812,3cyclictest4651-21sshd10:28:022
5628991811,5cyclictest29825-21sshd10:34:202
5628991810,6cyclictest4884-21sshd12:36:292
5625991816,1cyclictest0-21swapper/108:41:401
562999178,2cyclictest135650irq/27-eth010:32:483
562999174,8cyclictest29456-21sshd10:06:013
562999174,5cyclictest135650irq/27-eth010:02:193
562999170,8cyclictest1847-21nfsd11:45:333
562999170,11cyclictest1848-21nfsd07:20:293
562899176,5cyclictest10950irq/23-ehci_hcd09:50:422
5628991714,2cyclictest32313-21bash10:52:282
5628991711,4cyclictest9794-21bash10:17:552
562099177,9cyclictest0-21swapper/008:45:590
562099173,10cyclictest0-21swapper/008:18:430
562099170,16cyclictest0-21swapper/008:55:470
562099170,16cyclictest0-21swapper/008:06:530
562099170,16cyclictest0-21swapper/007:30:570
562099170,16cyclictest0-21swapper/007:16:100
562099170,12cyclictest0-21swapper/008:30:170
257072170,15sleep3144550irq/28-eth1-rx-09:05:063
562999165,4cyclictest1893-21nscd10:54:193
562999160,3cyclictest0-21swapper/308:30:133
562999160,14cyclictest0-21swapper/308:55:193
562899168,1cyclictest10950irq/23-ehci_hcd11:36:482
562899163,2cyclictest11616-21sshd09:25:582
5628991612,3cyclictest25016-21sshd09:13:202
562099164,10cyclictest0-21swapper/008:20:140
562099160,1cyclictest20831-21munin-node07:40:240
562099160,1cyclictest17303-21cut07:35:130
562099160,1cyclictest0-21swapper/009:05:200
562099160,1cyclictest0-21swapper/007:46:110
562099160,1cyclictest0-21swapper/007:21:260
562099160,12cyclictest0-21swapper/008:00:140
5629991510,1cyclictest10950irq/23-ehci_hcd08:40:223
562999150,6cyclictest0-21swapper/308:54:413
5628991511,3cyclictest10950irq/23-ehci_hcd07:42:412
5628991510,3cyclictest15501-21munin-node07:30:182
562099157,4cyclictest0-21swapper/007:56:000
562099150,8cyclictest142232sleep007:26:340
562099150,8cyclictest0-21swapper/008:14:330
562099150,1cyclictest0-21swapper/008:38:370
562099150,15cyclictest0-21swapper/008:50:520
562099150,14cyclictest8923-21timerwakeupswit08:25:220
562099150,11cyclictest0-21swapper/007:10:160
562999140,13cyclictest0-21swapper/308:25:183
562999140,12cyclictest25169-21smart_sda07:50:223
562899149,4cyclictest135650irq/27-eth008:55:502
562899149,3cyclictest8683-21iostat_ios07:15:162
562899148,5cyclictest0-21swapper/208:35:152
562899147,6cyclictest2405-21runrttasks07:45:262
562899145,8cyclictest0-21swapper/208:50:012
562899144,9cyclictest10950irq/23-ehci_hcd08:30:202
562899143,3cyclictest10950irq/23-ehci_hcd07:38:462
5628991412,1cyclictest0-21swapper/208:24:482
562899141,11cyclictest28764-21diskstats08:00:122
562899140,13cyclictest0-21swapper/208:14:272
562599149,4cyclictest135650irq/27-eth007:32:281
562599145,3cyclictest10950irq/23-ehci_hcd08:45:191
562599144,2cyclictest0-21swapper/108:15:171
562599143,4cyclictest10950irq/23-ehci_hcd07:50:121
562599142,11cyclictest10950irq/23-ehci_hcd08:50:521
5625991411,1cyclictest0-21swapper/109:06:011
5625991410,3cyclictest10950irq/23-ehci_hcd08:06:521
562099140,1cyclictest0-21swapper/007:50:460
562999137,5cyclictest0-21swapper/308:20:303
562999134,8cyclictest0-21swapper/307:15:213
562999132,10cyclictest10950irq/23-ehci_hcd07:31:353
562999130,4cyclictest4220-21swap08:15:233
562999130,4cyclictest26150-21munin-node07:55:173
562999130,4cyclictest18348-21munin-node07:35:233
562999130,12cyclictest0-21swapper/308:47:343
562999130,12cyclictest0-21swapper/308:38:093
562999130,12cyclictest0-21swapper/307:28:573
562999130,12cyclictest0-21swapper/307:13:483
562999130,11cyclictest544-21munin-node08:10:143
562999130,11cyclictest24197-21iostat_ios09:00:173
562999130,11cyclictest2405-21runrttasks08:05:113
562999130,11cyclictest21921-21df_inode07:45:153
562999130,11cyclictest19996-21hddtemp_smartct07:40:163
562899138,4cyclictest26492-21fschecks_count07:55:142
562899138,3cyclictest8352-21load08:25:162
562899131,11cyclictest18312-21runrttasks08:46:142
562899130,4cyclictest2405-21runrttasks08:15:082
562899130,12cyclictest1848-21nfsd08:41:532
562899130,12cyclictest0-21swapper/209:03:342
562899130,12cyclictest0-21swapper/208:06:582
562899130,12cyclictest0-21swapper/207:25:022
562599137,5cyclictest0-21swapper/109:04:531
562599133,9cyclictest0-21swapper/107:57:241
562599132,2cyclictest0-21swapper/107:10:151
562599132,10cyclictest10950irq/23-ehci_hcd08:04:111
562999126,4cyclictest28437-21munin-node08:00:113
562899127,4cyclictest0-21swapper/209:05:052
562899122,9cyclictest1847-21nfsd07:20:192
562899120,3cyclictest7014-21ls07:10:232
562599129,2cyclictest0-21swapper/108:31:141
562599129,2cyclictest0-21swapper/107:45:501
562599129,2cyclictest0-21swapper/107:40:411
562599124,1cyclictest17040-21munin-node07:35:201
562599121,3cyclictest0-21swapper/108:10:191
562599121,10cyclictest135650irq/27-eth007:21:081
562599121,0cyclictest0-21swapper/108:25:171
5625991210,1cyclictest0-21swapper/108:59:241
562599117,3cyclictest13158-21hddtemp_smartct07:25:151
562599116,4cyclictest36-21rcuop/208:20:501
562599111,9cyclictest0-21swapper/107:15:181
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional