You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-11 - 07:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot2s.osadl.org (updated Mon May 11, 2026 00:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2196316997969,6cyclictest86-21hwrng22:35:593
2196314997770,4cyclictest0-21swapper/100:15:191
2196316997667,5cyclictest86-21hwrng22:06:173
2196316997566,6cyclictest86-21hwrng20:04:263
2196314997568,4cyclictest0-21swapper/100:27:361
2196314997568,4cyclictest0-21swapper/100:27:361
2196313997567,5cyclictest86-21hwrng19:30:390
2196316997463,8cyclictest86-21hwrng21:59:073
2196316997463,8cyclictest86-21hwrng21:59:073
2196316997365,5cyclictest86-21hwrng21:51:573
2196316997365,5cyclictest86-21hwrng21:51:573
2196316997364,7cyclictest86-21hwrng23:31:173
2196316997364,5cyclictest86-21hwrng20:58:423
2196313997364,5cyclictest86-21hwrng21:30:270
2196316997264,5cyclictest86-21hwrng19:50:063
2196316997163,5cyclictest86-21hwrng20:26:583
2196316997064,4cyclictest86-21hwrng00:30:403
2196316997062,5cyclictest86-21hwrng22:47:153
2196316997061,6cyclictest86-21hwrng21:04:513
2196313997062,5cyclictest86-21hwrng00:25:330
2196313997062,5cyclictest86-21hwrng00:25:330
2196316996962,5cyclictest86-21hwrng19:59:193
2196316996961,5cyclictest86-21hwrng21:41:433
2196316996961,5cyclictest86-21hwrng21:41:433
2196316996961,5cyclictest86-21hwrng20:11:363
2196315996963,4cyclictest0-21swapper/200:23:302
2196315996963,3cyclictest0-21swapper/221:33:312
2196316996860,6cyclictest86-21hwrng20:07:303
2196316996859,6cyclictest86-21hwrng21:39:403
2196316996859,6cyclictest86-21hwrng20:31:043
2196315996862,3cyclictest0-21swapper/222:58:312
2196314996861,4cyclictest0-21swapper/100:10:121
2196313996860,5cyclictest86-21hwrng00:04:030
2196313996860,5cyclictest86-21hwrng00:04:030
2196316996760,5cyclictest86-21hwrng19:41:543
2196316996759,5cyclictest86-21hwrng20:16:433
2196314996758,5cyclictest0-21swapper/123:58:561
2196314996758,5cyclictest0-21swapper/123:58:561
2196316996659,5cyclictest86-21hwrng22:18:353
2196316996659,5cyclictest86-21hwrng22:18:353
2196316996457,5cyclictest86-21hwrng20:22:523
2196313996457,4cyclictest10650irq/147-8000000.ethernet-tx421:50:370
2196313996457,4cyclictest10650irq/147-8000000.ethernet-tx421:50:370
2196316996353,7cyclictest86-21hwrng22:20:383
2196316996254,5cyclictest86-21hwrng23:43:343
2196314996155,3cyclictest0-21swapper/123:03:381
2196314996054,3cyclictest0-21swapper/121:35:341
2196316995952,5cyclictest86-21hwrng20:36:113
2196313995816,38cyclictest2285024-21ssh22:25:170
2196313995816,38cyclictest2285024-21ssh22:25:170
2196314995750,4cyclictest0-21swapper/121:34:331
2196314995748,4cyclictest0-21swapper/119:28:361
2196313995721,31cyclictest2298400-21ssh22:45:120
2196313995712,41cyclictest2346299-21ntp_states23:55:580
2196313995712,41cyclictest2346299-21ntp_states23:55:580
2196313995648,5cyclictest86-21hwrng22:58:310
2196313995648,5cyclictest86-21hwrng00:23:300
2196313995628,25cyclictest2234349-21kworker/u16:4+rpciod21:25:400
2196313995628,25cyclictest2234349-21kworker/u16:4+rpciod21:25:400
2196314995548,4cyclictest0-21swapper/123:05:411
2196313995515,35cyclictest2321882-21ssh23:20:200
2196313995515,35cyclictest2321882-21ssh23:20:200
2196313995514,36cyclictest2264911-21ssh21:55:190
2196313995514,36cyclictest2264911-21ssh21:55:190
2196316995446,5cyclictest86-21hwrng22:42:083
2196316995446,5cyclictest86-21hwrng22:42:083
2196313995427,24cyclictest2359252-21/usr/sbin/munin00:15:370
2196313995425,9cyclictest2210803-21apt-get19:55:130
2196313995425,8cyclictest2296109-21ntpq22:40:530
2196313995425,8cyclictest2296109-21ntpq22:40:530
2196313995424,25cyclictest2205801-21kworker/u16:2+rpciod20:04:580
2196313995424,24cyclictest2271589-21ssh22:05:140
2196313995423,28cyclictest2321537-21sendmail23:19:580
2196313995423,28cyclictest2321537-21sendmail23:19:580
2196313995422,27cyclictest2255493-21/usr/sbin/munin21:40:350
2196313995422,27cyclictest2255493-21/usr/sbin/munin21:40:350
2196313995417,30cyclictest2335046-21latency_hist23:40:000
2196313995417,30cyclictest2335046-21latency_hist23:40:000
2196313995416,34cyclictest2338562-21ssh23:45:190
2196313995414,34cyclictest2251494-21ssh21:35:190
2196313995347,4cyclictest23-21rcuc/022:50:310
2196313995335,15cyclictest2222674-21ntpq20:30:410
2196313995330,18cyclictest2238010-21apt-get21:15:110
2196313995326,25cyclictest2197359-21ntpq19:10:490
2196313995325,25cyclictest2329512-21ntpq23:30:550
2196313995322,27cyclictest2259109-21ld21:45:550
2196313995321,29cyclictest2237479-21ssh21:14:180
2196313995320,13cyclictest2294789-21ssh22:39:590
2196313995315,35cyclictest0-21swapper/019:15:190
2196313995244,5cyclictest171ktimers/020:59:580
2196313995234,13cyclictest2354557-21ssh00:09:000
2196313995228,3cyclictest2228494-21/usr/sbin/munin20:50:270
2196313995227,22cyclictest2199976-21diskstats19:20:280
2196313995224,24cyclictest0-21swapper/020:20:000
2196313995224,23cyclictest0-21swapper/023:25:140
2196313995223,7cyclictest0-21swapper/021:09:590
2196313995222,27cyclictest2243699-21ssh21:22:570
2196313995213,35cyclictest2312909-21ntp_states23:05:580
2196313995213,18cyclictest2231783-21grep21:00:290
2196313995131,14cyclictest2226650-21munin-node20:45:090
2196313995131,14cyclictest2226650-21munin-node20:45:090
2196313995128,16cyclictest2204455-21apt-get19:35:130
2196313995121,26cyclictest2270111-21ssh22:01:530
2196313995121,12cyclictest0-21swapper/022:30:400
2196313995121,12cyclictest0-21swapper/022:30:400
2196313995120,5cyclictest2275767-21/usr/sbin/munin22:10:390
2196313995117,30cyclictest2219586-21ntp_states20:20:480
2196313995115,32cyclictest2368469-21ssh00:30:170
2196313995114,33cyclictest2309467-21ntpq23:00:530
2196316995020,21cyclictest2331876-21ssh23:35:223
2196316995020,21cyclictest2331876-21ssh23:35:223
2196313995028,17cyclictest2355176-21apt-get00:10:140
2196313995024,20cyclictest2283713-21ssh22:22:190
2196313995023,23cyclictest2315891-21memory23:10:350
2196313995017,29cyclictest2341913-21ssh23:50:160
2196313995014,9cyclictest2279056-21strings22:15:350
2196313995014,9cyclictest2279056-21strings22:15:350
2196316994920,19cyclictest2289892-21/usr/sbin/munin22:31:053
2196316994920,19cyclictest2289892-21/usr/sbin/munin22:31:053
219631699491,20cyclictest2349686-21ntpq00:01:013
219631699491,20cyclictest2349686-21ntpq00:01:013
2196313994934,11cyclictest2336977-21ssh23:41:370
2196313994931,14cyclictest2206790-21ntpq19:40:380
2196313994929,15cyclictest2213989-21apt-get20:05:130
2196313994920,7cyclictest2372827-21ntp_states00:35:550
2196316994840,5cyclictest86-21hwrng23:45:373
2196316994819,19cyclictest2245645-21ssh21:25:423
2196316994819,19cyclictest2245645-21ssh21:25:423
2196315994842,3cyclictest0-21swapper/219:24:302
2196314994842,3cyclictest0-21swapper/121:24:181
2196313994828,18cyclictest2216322-21ntpq20:10:380
2196313994827,15cyclictest2209212-21apt-get19:50:080
2196313994825,16cyclictest2207636-21apt-get19:45:120
2196313994820,24cyclictest0-21swapper/019:29:570
2196316994724,20cyclictest0-21swapper/322:10:283
2196316994723,21cyclictest0-21swapper/322:50:473
219631699472,16cyclictest2308549-21/usr/sbin/munin23:00:263
2196313994726,15cyclictest2220330-21apt-get20:25:130
2196313994722,19cyclictest2223484-21apt-get20:35:100
2196313994720,5cyclictest2225816-21ntp_kernel_err20:40:370
2196313994720,5cyclictest2225816-21ntp_kernel_err20:40:370
2196316994619,24cyclictest0-21swapper/319:20:093
2196315994641,3cyclictest0-21swapper/223:11:502
2196316994534,9cyclictest0-21swapper/322:25:493
2196316994534,9cyclictest0-21swapper/322:25:493
219631699452,37cyclictest2258237-21ssh21:45:263
2196316994523,19cyclictest0-21swapper/300:25:433
2196316994523,19cyclictest0-21swapper/300:25:433
2196316994522,18cyclictest0-21swapper/319:10:403
2196316994519,21cyclictest2316133-21ssh23:10:483
2196316994420,20cyclictest2242402-21ntpq21:20:513
2196316994415,26cyclictest2344873-21ssh23:54:453
2196315994437,4cyclictest0-21swapper/200:15:192
2196314994438,3cyclictest0-21swapper/121:12:011
2196316994323,18cyclictest0-21swapper/323:55:463
2196316994323,18cyclictest0-21swapper/323:55:463
219631699422,35cyclictest2362805-21ssh00:21:013
2196316994222,18cyclictest0-21swapper/323:15:483
2196316994222,18cyclictest0-21swapper/323:15:483
2196316994218,20cyclictest2306076-21ssh22:55:443
219631699421,16cyclictest2235698-21ntpq21:10:513
2196316994123,13cyclictest2355540-21/usr/sbin/munin00:10:293
2196316994122,17cyclictest0-21swapper/321:15:283
2196316994122,17cyclictest0-21swapper/319:45:403
2196316994122,16cyclictest0-21swapper/321:05:273
2196316994121,16cyclictest2371862-21aten_r8power_en00:35:223
2196316994121,16cyclictest2227412-21/usr/sbin/munin20:45:403
2196316994121,16cyclictest2227412-21/usr/sbin/munin20:45:403
2196316994121,14cyclictest2198653-21uname19:15:433
2196316994120,18cyclictest0-21swapper/323:26:013
2196316994116,18cyclictest2352774-21ssh00:05:413
2196316994116,17cyclictest2205180-21ntpq19:35:373
2196316994115,22cyclictest1773-21snmpd23:07:063
219631699411,35cyclictest2321559-21sendmail-msp23:20:033
219631699411,35cyclictest2321559-21sendmail-msp23:20:033
2196315994135,3cyclictest0-21swapper/200:27:362
2196315994135,3cyclictest0-21swapper/200:27:362
2196314994135,3cyclictest0-21swapper/122:55:111
2196314994133,5cyclictest0-21swapper/119:23:291
2196316994021,17cyclictest0-21swapper/320:40:263
2196316994021,17cyclictest0-21swapper/320:40:263
2196316994020,7cyclictest0-21swapper/319:25:483
219631699401,18cyclictest2359717-21mailstats00:16:033
219631699401,18cyclictest2268264-21ssh22:00:213
2196315994034,3cyclictest0-21swapper/223:01:202
2196315994026,11cyclictest0-21swapper/220:15:512
2196315994024,13cyclictest0-21swapper/221:55:352
2196315994024,13cyclictest0-21swapper/221:55:352
2196316993915,21cyclictest0-21swapper/321:30:273
2196316993819,17cyclictest0-21swapper/320:50:353
2196315993824,11cyclictest0-21swapper/222:40:522
2196315993824,11cyclictest0-21swapper/222:40:522
2196315993823,11cyclictest0-21swapper/222:35:472
2196316993715,18cyclictest2203740-21ntpq19:30:533
2196315993731,3cyclictest0-21swapper/221:35:112
2196315993725,9cyclictest0-21swapper/220:40:532
2196315993725,9cyclictest0-21swapper/220:40:532
2196315993724,10cyclictest0-21swapper/223:55:172
2196315993724,10cyclictest0-21swapper/223:55:172
2196315993723,11cyclictest0-21swapper/222:25:512
2196315993723,11cyclictest0-21swapper/222:25:512
2196314993731,3cyclictest0-21swapper/119:31:401
2196314993731,3cyclictest0-21swapper/100:24:401
2196315993623,10cyclictest0-21swapper/222:10:512
2196315993621,12cyclictest0-21swapper/220:30:302
2196315993621,11cyclictest0-21swapper/221:40:592
2196315993621,11cyclictest0-21swapper/221:40:592
2196315993619,14cyclictest0-21swapper/223:24:592
2196315993619,14cyclictest0-21swapper/223:24:592
2196315993619,13cyclictest0-21swapper/200:00:242
2196315993619,13cyclictest0-21swapper/200:00:242
2196316993515,10cyclictest2190762-21kworker/u16:19+rpciod19:10:003
2196315993528,4cyclictest0-21swapper/219:55:092
2196315993524,9cyclictest0-21swapper/221:25:572
2196315993524,9cyclictest0-21swapper/221:25:572
2196315993522,11cyclictest0-21swapper/222:20:472
2196315993521,11cyclictest0-21swapper/221:50:142
2196315993521,11cyclictest0-21swapper/221:50:142
2196315993521,11cyclictest0-21swapper/219:40:002
2196315993520,11cyclictest0-21swapper/222:15:172
2196315993520,11cyclictest0-21swapper/222:15:172
2196315993519,13cyclictest0-21swapper/222:05:002
2196315993519,12cyclictest0-21swapper/220:55:272
2196315993519,12cyclictest0-21swapper/200:05:192
2196315993518,13cyclictest0-21swapper/221:20:322
2196315993518,13cyclictest0-21swapper/200:35:442
2196315993518,12cyclictest0-21swapper/223:35:552
2196315993518,12cyclictest0-21swapper/223:35:552
2196315993517,14cyclictest0-21swapper/223:26:002
2196314993528,4cyclictest0-21swapper/121:50:371
2196314993528,4cyclictest0-21swapper/121:50:371
2196314993528,4cyclictest0-21swapper/119:40:531
2196313993521,10cyclictest2196301-21munin-run19:09:580
2196315993428,3cyclictest0-21swapper/200:10:122
2196315993422,9cyclictest0-21swapper/219:29:262
2196315993422,10cyclictest0-21swapper/223:15:592
2196315993422,10cyclictest0-21swapper/223:15:592
2196315993420,11cyclictest0-21swapper/221:45:342
2196315993419,11cyclictest0-21swapper/223:40:322
2196315993419,11cyclictest0-21swapper/223:05:202
2196315993419,11cyclictest0-21swapper/220:50:562
2196315993418,12cyclictest0-21swapper/222:45:182
2196315993417,13cyclictest0-21swapper/200:30:452
2196315993416,14cyclictest0-21swapper/222:30:512
2196315993416,14cyclictest0-21swapper/222:30:512
2196314993428,3cyclictest0-21swapper/122:52:281
2196314993428,3cyclictest0-21swapper/122:28:591
2196314993428,3cyclictest0-21swapper/122:28:591
2196314993427,4cyclictest0-21swapper/121:25:381
2196314993427,4cyclictest0-21swapper/121:25:381
2196314993423,7cyclictest0-21swapper/121:15:421
2196315993321,9cyclictest0-21swapper/221:15:152
2196315993320,10cyclictest0-21swapper/221:05:592
2196315993319,10cyclictest0-21swapper/220:00:562
2196315993318,12cyclictest0-21swapper/222:50:382
2196315993318,11cyclictest0-21swapper/223:30:202
2196315993317,13cyclictest0-21swapper/220:11:272
2196315993316,14cyclictest0-21swapper/222:05:202
2196315993316,13cyclictest0-21swapper/221:10:112
2196315993316,13cyclictest0-21swapper/219:45:222
2196314993327,3cyclictest0-21swapper/122:03:051
2196314993326,4cyclictest0-21swapper/120:00:571
2196314993325,5cyclictest0-21swapper/122:45:111
2196315993219,10cyclictest0-21swapper/219:15:102
2196315993218,11cyclictest0-21swapper/223:55:002
2196315993218,11cyclictest0-21swapper/220:40:012
2196315993218,11cyclictest0-21swapper/220:25:302
2196315993217,12cyclictest0-21swapper/223:45:112
2196315993217,12cyclictest0-21swapper/219:40:582
2196315993216,12cyclictest0-21swapper/220:05:232
2196315993216,12cyclictest0-21swapper/219:50:352
2196315993216,12cyclictest0-21swapper/219:14:592
2196315993213,13cyclictest0-21swapper/220:45:132
2196315993213,13cyclictest0-21swapper/220:45:132
2196314993226,3cyclictest0-21swapper/120:27:331
2196314993225,4cyclictest0-21swapper/123:20:111
2196314993225,4cyclictest0-21swapper/123:20:111
2196314993225,4cyclictest0-21swapper/100:34:521
2196314993224,5cyclictest0-21swapper/121:45:231
2196315993119,10cyclictest0-21swapper/220:20:222
2196314993125,4cyclictest0-21swapper/120:20:011
2196314993124,4cyclictest0-21swapper/121:00:001
2196314993123,5cyclictest0-21swapper/122:15:561
2196314993123,5cyclictest0-21swapper/122:15:561
2196314993122,5cyclictest0-21swapper/123:45:341
2196314993120,7cyclictest0-21swapper/121:55:391
2196314993120,7cyclictest0-21swapper/121:55:391
2196315993017,10cyclictest0-21swapper/219:30:272
2196315993016,11cyclictest0-21swapper/221:00:252
2196314993024,3cyclictest0-21swapper/121:40:541
2196314993024,3cyclictest0-21swapper/121:40:541
2196314992924,3cyclictest0-21swapper/122:40:161
2196314992924,3cyclictest0-21swapper/122:40:161
2196314992923,4cyclictest0-21swapper/100:40:011
2196314992923,3cyclictest0-21swapper/123:30:201
2196314992923,3cyclictest0-21swapper/120:49:291
2196314992923,3cyclictest0-21swapper/120:49:291
2196314992922,4cyclictest0-21swapper/123:25:141
2196314992921,5cyclictest0-21swapper/123:10:541
2196314992921,5cyclictest0-21swapper/122:35:331
2196314992921,5cyclictest0-21swapper/122:30:201
2196314992921,5cyclictest0-21swapper/122:30:201
2196314992919,6cyclictest0-21swapper/119:35:271
2196314992822,4cyclictest0-21swapper/123:50:351
2196314992822,4cyclictest0-21swapper/119:15:161
2196314992822,3cyclictest0-21swapper/120:50:441
2196314992822,3cyclictest0-21swapper/120:35:541
2196314992822,3cyclictest0-21swapper/119:10:101
2196314992821,4cyclictest0-21swapper/122:20:151
2196314992820,4cyclictest0-21swapper/100:00:101
2196314992820,4cyclictest0-21swapper/100:00:101
2196314992819,5cyclictest0-21swapper/121:05:331
2196314992722,3cyclictest0-21swapper/123:40:361
2196314992722,3cyclictest0-21swapper/122:05:211
2196314992721,4cyclictest0-21swapper/120:30:301
2196314992721,3cyclictest0-21swapper/123:35:401
2196314992721,3cyclictest0-21swapper/123:35:401
2196314992721,3cyclictest0-21swapper/100:05:121
2196314992720,4cyclictest0-21swapper/123:15:151
2196314992720,4cyclictest0-21swapper/123:15:151
2196314992720,4cyclictest0-21swapper/120:40:271
2196314992720,4cyclictest0-21swapper/120:40:271
2196314992720,4cyclictest0-21swapper/119:55:121
2196314992720,4cyclictest0-21swapper/119:45:231
2196314992719,4cyclictest0-21swapper/122:10:151
2196314992621,3cyclictest0-21swapper/121:00:471
2196314992621,3cyclictest0-21swapper/120:24:071
2196314992621,3cyclictest0-21swapper/119:50:221
2196314992620,3cyclictest0-21swapper/120:05:281
2196314992619,4cyclictest0-21swapper/120:10:201
2196315992317,3cyclictest0-21swapper/219:09:582
2196314992015,3cyclictest0-21swapper/119:10:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional