You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-06 - 10:45
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack5slot0.osadl.org (updated Sat Dec 06, 2025 00:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
604121680,1sleep30-21swapper/321:43:243
2969121350,1sleep329690-21sshd22:09:423
2848821350,4sleep11205199cyclictest22:49:571
558021290,4sleep11205199cyclictest21:16:211
2898421270,3sleep11205199cyclictest00:02:471
2152421230,2sleep10-21swapper/121:56:491
1464921170,0sleep214648-21sshd00:17:352
1802921140,2sleep31206299cyclictest22:51:583
2684521110,0sleep00-21swapper/021:57:200
2872021090,4sleep11205199cyclictest22:03:351
3157421060,1sleep331565-21sshd23:47:133
2342121050,1sleep10-21swapper/123:36:571
1178921040,1sleep08-21rcu_preempt23:20:050
554721010,0sleep00-21swapper/023:29:000
175792980,2sleep217575-21bash23:36:222
56712930,1sleep20-21swapper/221:49:252
69732900,2sleep16967-21users22:35:251
307632890,1sleep31847-21nfsd21:21:403
8972880,6sleep30-21swapper/321:48:583
4652880,1sleep20-21swapper/223:28:292
304942880,4sleep230491-21cp21:15:382
292202880,0sleep00-21swapper/021:27:340
260572870,4sleep01204599cyclictest22:59:100
65682860,1sleep30-21swapper/321:52:263
318392860,1sleep20-21swapper/221:39:512
296082860,1sleep329573-21sshd23:25:013
1159028534,38sleep30-21swapper/319:07:083
1150928333,45sleep10-21swapper/119:06:061
49142800,1sleep04916-21sshd23:38:210
315202800,1sleep10-21swapper/100:29:401
309662790,2sleep330961-21sshd23:37:443
177332790,1sleep10-21swapper/123:14:211
266662780,1sleep344-21ksoftirqd/322:21:363
256042770,2sleep125605-21sshd21:21:101
322042750,3sleep10-21swapper/122:56:291
27622750,0sleep00-21swapper/022:38:130
34652740,2sleep00-21swapper/023:19:170
131792740,1sleep313181-21id21:59:083
150992730,2sleep215098-21bash00:14:272
1176827334,9sleep20-21swapper/219:09:242
136592720,2sleep30-21swapper/323:23:253
35232710,1sleep10-21swapper/123:44:391
324742710,2sleep21205799cyclictest23:09:262
308622690,2sleep20-21swapper/221:00:192
308622690,2sleep20-21swapper/221:00:192
181192690,1sleep10-21swapper/122:11:321
120432680,2sleep20-21swapper/222:01:592
157282670,1sleep11205199cyclictest23:48:521
58812650,4sleep31206299cyclictest22:44:413
282802620,2sleep30-21swapper/323:50:063
276242610,4sleep21848-21nfsd21:51:212
1163625732,13sleep00-21swapper/019:07:410
324552490,1sleep10-21swapper/123:06:111
318972490,0sleep231899-21id23:31:292
50852400,38sleep126950irq/26-ahci[00023:54:111
12045994033,5cyclictest28445-21sshd23:40:340
12045993931,6cyclictest30774-21sshd00:33:090
12045993931,6cyclictest30774-21sshd00:33:090
12045993813,22cyclictest3-21ksoftirqd/023:06:460
12057993723,8cyclictest2065-21id23:03:162
12057993631,3cyclictest11579-21sshd00:04:182
12057993629,5cyclictest20777-21bash22:42:582
12057993629,5cyclictest20091-21sshd00:24:482
12057993520,13cyclictest0-21swapper/223:22:272
12045993511,16cyclictest3-21ksoftirqd/023:57:550
12057993428,3cyclictest12893-21sshd22:39:132
12057993427,4cyclictest583-21sshd22:19:092
12057993426,4cyclictest2929-21sshd22:56:492
12057993326,4cyclictest19544-21bash21:26:382
12057993325,4cyclictest7213-21sshd22:07:342
12057993323,7cyclictest16783-21bash23:42:452
12045993315,4cyclictest3-21ksoftirqd/022:25:030
1204599331,27cyclictest0-21swapper/021:54:460
12057993228,2cyclictest11064-21sshd22:29:372
12057993227,3cyclictest6279-21sshd21:55:222
12057993225,4cyclictest8312-21sshd22:50:592
12057993225,4cyclictest2715-21sshd00:26:152
12057993225,4cyclictest21813-21sshd23:58:572
12057993225,4cyclictest10056-21diskstats23:45:142
12057993224,4cyclictest31391-21sshd22:12:482
12057993223,4cyclictest8310-21bash21:34:402
12045993213,13cyclictest3-21ksoftirqd/021:35:480
1205799314,5cyclictest5221-21sshd21:43:212
12057993126,3cyclictest17465-21sshd21:11:222
12057993125,4cyclictest8857-21sshd00:30:342
12057993125,4cyclictest8857-21sshd00:30:342
12057993024,3cyclictest2754-21sshd00:06:402
12057993023,4cyclictest5046-21sshd23:19:262
12057993023,4cyclictest17136-21sshd22:48:492
12057993023,4cyclictest15066-21sshd22:20:272
12057993023,3cyclictest1848-21nfsd23:52:012
12057993018,9cyclictest1959-21sshd22:30:132
12057993018,9cyclictest1959-21sshd22:30:132
1204599306,2cyclictest0-21swapper/021:32:220
12057992923,4cyclictest19770-21sshd21:23:432
12057992919,8cyclictest16412-21sshd23:14:132
12057992919,6cyclictest12108-21sshd00:38:172
1204599280,25cyclictest0-21swapper/021:41:190
288672272,23sleep1135650irq/27-eth023:18:361
12045992715,11cyclictest3-21ksoftirqd/022:02:290
294422260,24sleep3135650irq/27-eth023:05:543
1206299263,0cyclictest0-21swapper/323:19:563
295342250,3sleep30-21swapper/323:40:403
204492250,2sleep11847-21nfsd22:52:121
1204599250,17cyclictest30537-21sshd00:02:570
131872240,22sleep1135650irq/27-eth022:08:081
12057992419,3cyclictest23250-21crond19:35:002
12045992412,4cyclictest5152-21sshd22:13:230
1204599241,21cyclictest8862-21sshd00:13:480
1204599240,20cyclictest10-21rcuc/000:28:470
1204599240,15cyclictest3550-21sshd23:31:550
260682230,3sleep11848-21nfsd21:42:141
223062230,2sleep30-21swapper/323:55:443
1206299238,6cyclictest135650irq/27-eth023:32:373
12057992312,6cyclictest16798-21sort20:30:162
12051992318,3cyclictest0-21swapper/100:33:091
12051992318,3cyclictest0-21swapper/100:33:091
1204599231,20cyclictest0-21swapper/000:22:100
1204599230,3cyclictest30466-21sshd22:09:460
1204599230,2cyclictest0-21swapper/019:25:100
117562230,2sleep111750-21bash00:10:441
31542220,2sleep03130-21sshd22:22:290
300042220,3sleep30-21swapper/321:15:353
276192220,2sleep327613-21sshd23:02:333
12062992211,8cyclictest19277-21sshd22:49:033
12057992217,3cyclictest2043-21bash21:10:002
1205199227,4cyclictest2460-21sshd22:25:291
1205199225,5cyclictest3327-21sshd00:16:251
12051992217,3cyclictest30530-21sshd00:06:081
12051992214,6cyclictest1893-21nscd22:42:001
12051992214,3cyclictest25240-21sshd22:34:101
12051992214,3cyclictest25240-21sshd22:34:101
12051992214,2cyclictest0-21swapper/121:50:441
1204599221,4cyclictest0-21swapper/000:19:260
1204599221,3cyclictest0-21swapper/021:24:460
1204599220,1cyclictest27417-21sshd22:49:500
1204599220,16cyclictest0-21swapper/021:14:090
1206299218,6cyclictest10950irq/23-ehci_hcd00:03:183
12062992110,5cyclictest10950irq/23-ehci_hcd19:30:183
1205199212,6cyclictest0-21swapper/100:24:191
12051992113,6cyclictest30923-21sshd21:27:441
12051992111,2cyclictest15285-21sshd21:35:151
1204599218,8cyclictest19788-21sshd23:52:220
12045992115,5cyclictest3-21ksoftirqd/022:40:520
12045992113,7cyclictest3-21ksoftirqd/022:31:100
12045992113,7cyclictest3-21ksoftirqd/022:31:100
1204599210,9cyclictest1847-21nfsd00:09:000
1204599210,3cyclictest9278-21sshd23:00:370
1204599210,3cyclictest0-21swapper/000:37:520
1204599210,17cyclictest22666-21sshd23:46:220
88322200,14sleep1135650irq/27-eth023:26:041
27722200,2sleep00-21swapper/021:46:020
269582200,2sleep326945-21sshd00:05:453
139402200,18sleep3135650irq/27-eth022:57:573
1206299209,3cyclictest0-21swapper/322:03:383
1206299208,2cyclictest10950irq/23-ehci_hcd21:34:353
1206299208,10cyclictest27726-21sshd22:28:033
1206299206,5cyclictest135650irq/27-eth021:38:583
12062992012,3cyclictest23010-21sshd22:12:003
12062992011,2cyclictest135650irq/27-eth000:15:523
1205799208,8cyclictest20532-21crond20:40:002
12057992015,3cyclictest0-21swapper/219:10:142
1205199209,3cyclictest10950irq/23-ehci_hcd22:18:481
1205199206,5cyclictest10950irq/23-ehci_hcd23:03:011
1205199204,8cyclictest0-21swapper/121:48:361
1205199203,7cyclictest6228-21sshd23:22:401
1204599205,12cyclictest8914-21sshd23:13:280
1204599201,18cyclictest24092-21sshd22:18:170
1204599201,16cyclictest0-21swapper/022:50:310
267412191,16sleep3135650irq/27-eth022:37:243
233562190,2sleep123353-21bash23:55:491
1206299196,4cyclictest11730-21sshd00:14:053
12057991915,2cyclictest25527-21crond19:40:002
12057991915,2cyclictest0-21swapper/219:15:132
12057991914,3cyclictest29865-21taskset19:47:132
12057991914,3cyclictest26966-21awk20:50:242
12057991913,3cyclictest17912-21sendmail_mailqu19:20:182
12051991914,4cyclictest29509-21cp21:33:361
12051991912,4cyclictest28853-21bash22:21:511
254482180,16sleep3135650irq/27-eth000:25:183
1206299183,1cyclictest6701-21sshd21:28:303
12062991814,3cyclictest0-21swapper/321:10:113
12062991811,4cyclictest17645-21bash00:35:153
12057991814,2cyclictest20655-21taskset19:26:052
12057991811,5cyclictest1915-21snmpd20:01:232
1204599181,5cyclictest26704-21sshd21:15:200
12045991815,2cyclictest0-21swapper/020:25:170
1206299174,4cyclictest28209-21sshd22:15:293
12062991710,5cyclictest1847-21nfsd00:34:513
12062991710,5cyclictest1847-21nfsd00:34:513
1206299170,8cyclictest0-21swapper/323:10:223
1206299170,15cyclictest17129-21cp22:33:203
1206299170,15cyclictest17129-21cp22:33:193
1205799170,15cyclictest11640-21munin-node20:20:152
12051991710,1cyclictest14948-21fschecks_time19:15:131
1205199170,1cyclictest19774-21cp21:14:451
1205199170,14cyclictest10665-21bash00:38:071
1206299160,4cyclictest1959-21sshd00:20:473
12057991611,4cyclictest6314-21unixbench-2d20:05:212
1205799160,14cyclictest13922-21munin-node20:25:192
1205199163,11cyclictest10524-21munin-node20:15:201
1205199160,5cyclictest22879-21sshd23:30:341
1204599167,8cyclictest0-21swapper/020:31:040
1204599164,11cyclictest0-21swapper/020:45:010
1206299153,0cyclictest0-21swapper/319:15:223
12062991511,3cyclictest10950irq/23-ehci_hcd20:17:123
1206299150,13cyclictest0-21swapper/320:30:153
1206299150,11cyclictest135650irq/27-eth019:40:083
1205799159,5cyclictest1848-21nfsd20:42:322
12057991512,2cyclictest0-21swapper/219:50:122
12057991510,3cyclictest11248-21taskset20:18:062
1205799150,14cyclictest24890-21sshd20:47:392
1205799150,13cyclictest7083-21munin-node20:10:172
1205199158,6cyclictest135650irq/27-eth019:44:031
1204599158,1cyclictest0-21swapper/019:45:340
1204599157,7cyclictest0-21swapper/021:05:470
1204599157,3cyclictest0-21swapper/020:20:040
1204599157,1cyclictest0-21swapper/019:19:000
1204599156,8cyclictest0-21swapper/019:56:280
1204599150,1cyclictest0-21swapper/019:20:330
1204599150,14cyclictest0-21swapper/020:54:390
1204599150,10cyclictest0-21swapper/020:10:520
1204599150,10cyclictest0-21swapper/019:13:450
1206299145,5cyclictest10950irq/23-ehci_hcd19:55:163
1206299144,9cyclictest0-21swapper/320:05:423
1206299142,11cyclictest135650irq/27-eth020:55:173
1206299142,11cyclictest10950irq/23-ehci_hcd19:47:183
12062991410,3cyclictest10950irq/23-ehci_hcd19:50:543
1206299140,11cyclictest0-21swapper/320:51:453
1205799142,5cyclictest135650irq/27-eth020:59:422
1205799141,12cyclictest0-21swapper/219:40:072
1205199148,5cyclictest0-21swapper/120:40:151
1205199143,3cyclictest10950irq/23-ehci_hcd19:45:431
1205199142,9cyclictest25271-21runrttasks19:36:501
1205199141,12cyclictest1848-21nfsd20:04:191
1205199140,5cyclictest1915-21snmpd21:05:561
1205199140,13cyclictest1848-21nfsd19:30:451
1205199140,13cyclictest0-21swapper/119:29:011
1205199140,12cyclictest28568-21head20:55:191
1204599148,6cyclictest0-21swapper/020:36:550
1204599146,5cyclictest0-21swapper/019:38:010
1204599141,9cyclictest0-21swapper/019:50:170
1204599140,1cyclictest0-21swapper/021:02:140
1204599140,1cyclictest0-21swapper/021:02:140
1204599140,1cyclictest0-21swapper/020:57:100
1204599140,1cyclictest0-21swapper/020:17:490
1204599140,1cyclictest0-21swapper/020:06:280
1204599140,1cyclictest0-21swapper/020:00:060
1204599140,1cyclictest0-21swapper/019:44:290
1204599140,14cyclictest0-21swapper/019:33:040
1204599140,13cyclictest0-21swapper/020:40:240
1206299137,5cyclictest135650irq/27-eth020:00:553
1206299132,10cyclictest10950irq/23-ehci_hcd20:21:043
1206299130,5cyclictest0-21swapper/320:35:133
1206299130,5cyclictest0-21swapper/319:25:173
1206299130,12cyclictest0-21swapper/321:05:573
1206299130,12cyclictest0-21swapper/320:43:013
1206299130,12cyclictest0-21swapper/320:26:453
1206299130,12cyclictest0-21swapper/319:21:133
1206299130,12cyclictest0-21swapper/319:10:123
1206299130,11cyclictest1848-21nfsd19:35:123
1205799139,3cyclictest917-21irqstats19:55:152
1205199138,3cyclictest7247-21munin-node20:10:161
1205199131,11cyclictest11974-21entropy20:20:131
1205199130,4cyclictest24221-21pmu-power20:45:171
1205199130,4cyclictest16965-21iostat_ios20:30:181
1205199130,12cyclictest26263-21grep20:50:171
1205199130,12cyclictest0-21swapper/121:04:361
1205199130,12cyclictest0-21swapper/121:04:361
1205199130,12cyclictest0-21swapper/119:23:381
1205199130,11cyclictest466-21diskstats19:55:121
1205199130,11cyclictest18746-21df20:35:121
1206299121,10cyclictest135650irq/27-eth021:00:083
1206299121,10cyclictest135650irq/27-eth021:00:083
12062991210,1cyclictest0-21swapper/320:48:533
1205199127,3cyclictest14014-21munin-node20:25:141
1205199120,3cyclictest5460-21munin-node20:05:121
1205199120,11cyclictest31087-21iostat_ios19:50:151
1205199120,11cyclictest12680-21perl19:10:141
1206299110,3cyclictest0-21swapper/320:10:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional