You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-24 - 00:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Sun Aug 23, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
23797212298,19sleep00-21swapper/007:07:200
23988211996,18sleep30-21swapper/307:09:473
239962116105,6sleep10-21swapper/107:09:531
23933211293,12sleep20-21swapper/207:09:062
133652760,1sleep20-21swapper/212:00:002
266342700,0sleep10-21swapper/111:06:281
267382360,0sleep2301ktimersoftd/209:28:292
2403599310,29cyclictest0-21swapper/311:00:123
24034992724,2cyclictest8402-21kworker/u8:109:22:042
24034992724,2cyclictest8402-21kworker/u8:109:22:042
24034992724,2cyclictest25546-21kworker/u8:009:40:052
24034992724,2cyclictest20794-21kworker/u8:111:11:042
24034992623,2cyclictest15145-21kworker/u8:010:22:062
24034992522,2cyclictest8464-21kworker/u8:109:53:042
24034992522,2cyclictest25546-21kworker/u8:010:02:042
24032992522,2cyclictest25546-21kworker/u8:009:56:010
24034992421,2cyclictest31281-21kworker/u8:110:40:042
24034992421,2cyclictest25871-21kworker/u8:011:22:012
24034992421,2cyclictest22777-21kworker/u8:212:18:042
2403499240,8cyclictest0-21swapper/209:14:042
24034992320,2cyclictest4765-21kworker/u8:210:50:042
24034992320,2cyclictest4765-21kworker/u8:210:47:052
24034992320,2cyclictest25871-21kworker/u8:011:17:042
24034992320,2cyclictest25546-21kworker/u8:009:45:042
24034992320,2cyclictest10260-21kworker/u8:211:27:042
24034992219,2cyclictest7931-21kworker/u8:107:52:012
24034992219,2cyclictest25871-21kworker/u8:011:09:042
24034992219,2cyclictest25546-21kworker/u8:009:38:042
24034992219,2cyclictest22138-21kworker/u8:208:31:042
24034992219,2cyclictest20794-21kworker/u8:111:52:042
24034992219,2cyclictest20794-21kworker/u8:111:48:042
24034992219,2cyclictest15942-21kworker/u8:011:30:042
24034992215,5cyclictest9665-21uptime10:16:042
24034992118,2cyclictest905-21kworker/u8:007:42:012
24034992118,2cyclictest3892-21kworker/u8:112:23:042
24034992118,2cyclictest31030-21kworker/u8:107:28:012
24034992118,2cyclictest1755-21kworker/u8:009:02:012
2403499210,18cyclictest0-21swapper/212:09:042
24032992118,2cyclictest25546-21kworker/u8:009:41:040
24034992017,2cyclictest4379-21kworker/u8:207:47:042
24034992017,2cyclictest26208-21kworker/u8:210:34:042
24034992017,2cyclictest22138-21kworker/u8:208:52:042
24034992017,2cyclictest22138-21kworker/u8:208:36:042
24034992017,2cyclictest20200-21kworker/u8:110:29:042
24034992017,2cyclictest18418-21kworker/u8:008:25:042
24034992017,2cyclictest12487-21kworker/u8:108:18:042
24034992017,2cyclictest12487-21kworker/u8:108:03:042
2403399200,2cyclictest0-21swapper/107:10:111
2403299200,2cyclictest0-21swapper/010:50:130
2403299200,18cyclictest0-21swapper/010:10:120
24035991914,3cyclictest17506-21ssh10:25:123
24034991916,2cyclictest8983-21kworker/u8:212:35:042
24034991916,2cyclictest4379-21kworker/u8:208:11:042
24034991916,2cyclictest4379-21kworker/u8:208:06:042
24034991916,2cyclictest22138-21kworker/u8:208:41:042
24034991916,2cyclictest1755-21kworker/u8:009:08:012
24034991916,2cyclictest1755-21kworker/u8:008:57:042
24034991916,2cyclictest16314-21kworker/u8:007:23:042
2403499190,2cyclictest0-21swapper/210:09:042
2403499190,2cyclictest0-21swapper/209:57:052
2403499190,17cyclictest0-21swapper/209:18:052
2403499190,17cyclictest0-21swapper/209:18:052
24032991916,2cyclictest22777-21kworker/u8:212:21:040
24034991815,2cyclictest8101-21kworker/u8:212:01:042
24034991815,2cyclictest31030-21kworker/u8:107:38:042
2403499180,2cyclictest19415-21ssh11:00:042
24032991815,2cyclictest8402-21kworker/u8:109:14:040
2403499170,2cyclictest0-21swapper/212:27:042
2403499170,2cyclictest0-21swapper/212:13:042
2403299170,15cyclictest0-21swapper/012:05:120
2403599161,3cyclictest31303-21munin-node3
2403599161,13cyclictest0-21swapper/308:25:143
24034991613,2cyclictest22138-21kworker/u8:208:46:012
2403499160,3cyclictest0-21swapper/209:31:042
2403499160,2cyclictest0-21swapper/208:22:012
24032991611,3cyclictest18091-21ssh11:30:560
61892150,3sleep06198-21sh11:51:330
2403599152,7cyclictest3728-21runrttasks09:00:003
2403599151,3cyclictest11156-21ssh09:45:153
2403599151,3cyclictest0-21swapper/311:59:233
24035991510,3cyclictest0-21swapper/309:33:063
2403599150,3cyclictest0-21swapper/312:11:033
2403599150,2cyclictest0-21swapper/310:51:053
2403599150,13cyclictest0-21swapper/309:17:233
2403599150,13cyclictest0-21swapper/309:17:223
2403599150,13cyclictest0-21swapper/307:30:143
24034991512,2cyclictest16314-21kworker/u8:007:11:042
24033991510,3cyclictest0-21swapper/111:45:011
2403399150,13cyclictest0-21swapper/107:50:141
24032991512,2cyclictest10018-21kworker/u8:007:56:040
24032991511,3cyclictest20200-21kworker/u8:110:30:040
2403299150,13cyclictest22132-21ssh09:23:560
2403299150,13cyclictest22132-21ssh09:23:560
2403599142,7cyclictest0-21swapper/308:45:003
2403599141,11cyclictest6970-21ssh09:40:413
24035991410,2cyclictest0-21swapper/312:09:413
24035991410,2cyclictest0-21swapper/309:25:323
2403599140,13cyclictest0-21swapper/312:00:153
2403599140,13cyclictest0-21swapper/309:55:153
2403599140,12cyclictest8615-21ssh12:27:163
2403599140,12cyclictest11872-21ssh12:30:253
2403499141,11cyclictest21480-21ssh11:35:112
2403499141,11cyclictest15565-21ntp_states10:55:182
2403399149,4cyclictest0-21swapper/111:52:541
2403399149,3cyclictest0-21swapper/108:00:141
2403399142,9cyclictest0-21swapper/108:39:581
24033991411,2cyclictest0-21swapper/112:12:411
2403399141,11cyclictest19497-21apt-get11:00:111
2403399141,11cyclictest0-21swapper/110:18:491
2403399140,2cyclictest0-21swapper/112:03:021
2403399140,13cyclictest0-21swapper/110:29:021
2403399140,12cyclictest5071-21ssh09:39:401
2403399140,12cyclictest3152-21nscd11:19:371
2403399140,12cyclictest27860-21ssh11:40:531
2403399140,12cyclictest20413-21latency_hist12:40:001
2403399140,12cyclictest0-21swapper/111:35:231
2403399140,12cyclictest0-21swapper/111:21:501
2403399140,12cyclictest0-21swapper/109:20:071
2403399140,12cyclictest0-21swapper/109:20:061
24032991411,2cyclictest8402-21kworker/u8:109:30:010
24032991411,2cyclictest4765-21kworker/u8:210:48:040
24032991411,2cyclictest28498-21kworker/u8:011:59:040
24032991411,2cyclictest0-21swapper/011:25:060
24032991411,2cyclictest0-21swapper/010:05:110
24032991411,2cyclictest0-21swapper/010:02:060
2403299140,2cyclictest0-21swapper/012:30:160
2403299140,2cyclictest0-21swapper/008:35:160
2403299140,2cyclictest0-21swapper/008:10:160
2403299140,13cyclictest0-21swapper/012:14:260
2403299140,13cyclictest0-21swapper/011:13:460
2403299140,13cyclictest0-21swapper/010:24:560
2403299140,13cyclictest0-21swapper/009:46:270
2403299140,12cyclictest7635-21munin-node0
2403599132,7cyclictest0-21swapper/310:06:023
2403599131,10cyclictest0-21swapper/310:16:103
24035991310,2cyclictest22519-21ssh09:24:313
24035991310,2cyclictest22519-21ssh09:24:313
24035991310,2cyclictest0-21swapper/312:18:323
24035991310,2cyclictest0-21swapper/311:51:333
24035991310,2cyclictest0-21swapper/311:30:143
24035991310,2cyclictest0-21swapper/311:06:323
24035991310,2cyclictest0-21swapper/310:47:233
24035991310,2cyclictest0-21swapper/310:40:183
24035991310,2cyclictest0-21swapper/310:23:343
24035991310,2cyclictest0-21swapper/310:12:233
24035991310,2cyclictest0-21swapper/310:00:033
24035991310,2cyclictest0-21swapper/309:05:193
24035991310,2cyclictest0-21swapper/307:55:153
2403599130,2cyclictest0-21swapper/311:15:453
2403599130,2cyclictest0-21swapper/307:35:473
2403599130,12cyclictest8096-21diskmemload11:41:513
2403599130,12cyclictest0-21swapper/312:20:113
2403599130,12cyclictest0-21swapper/310:39:533
2403599130,11cyclictest0-21swapper/311:35:123
2403599130,11cyclictest0-21swapper/308:10:143
2403599130,11cyclictest0-21swapper/307:45:193
2403399131,2cyclictest0-21swapper/111:31:081
24033991310,2cyclictest0-21swapper/111:29:211
24033991310,2cyclictest0-21swapper/110:59:291
24033991310,2cyclictest0-21swapper/110:32:291
24033991310,2cyclictest0-21swapper/110:06:211
24033991310,2cyclictest0-21swapper/110:04:001
24033991310,2cyclictest0-21swapper/109:50:201
24033991310,2cyclictest0-21swapper/109:30:091
24033991310,2cyclictest0-21swapper/109:15:191
24033991310,2cyclictest0-21swapper/109:15:191
24033991310,2cyclictest0-21swapper/108:45:511
24033991310,2cyclictest0-21swapper/107:41:011
24033991310,2cyclictest0-21swapper/107:30:201
2403399130,2cyclictest0-21swapper/112:22:301
2403399130,2cyclictest0-21swapper/110:47:061
2403399130,2cyclictest0-21swapper/110:37:181
2403399130,2cyclictest0-21swapper/110:24:361
2403399130,2cyclictest0-21swapper/110:11:051
2403399130,2cyclictest0-21swapper/109:55:151
2403399130,2cyclictest0-21swapper/109:26:051
2403399130,2cyclictest0-21swapper/108:50:191
2403399130,12cyclictest0-21swapper/112:05:121
2403399130,12cyclictest0-21swapper/111:58:591
2403399130,12cyclictest0-21swapper/111:10:591
2403399130,12cyclictest0-21swapper/110:51:311
2403399130,12cyclictest0-21swapper/109:40:141
2403399130,12cyclictest0-21swapper/109:11:591
2403399130,12cyclictest0-21swapper/108:40:511
2403399130,12cyclictest0-21swapper/108:20:171
2403399130,11cyclictest0-21swapper/112:32:221
2403299131,10cyclictest0-21swapper/011:21:410
24032991310,2cyclictest1755-21kworker/u8:009:18:010
24032991310,2cyclictest1755-21kworker/u8:009:18:010
24032991310,2cyclictest0-21swapper/012:36:160
24032991310,2cyclictest0-21swapper/012:27:500
24032991310,2cyclictest0-21swapper/011:17:280
24032991310,2cyclictest0-21swapper/010:44:490
2403299130,2cyclictest0-21swapper/012:15:180
2403299130,2cyclictest0-21swapper/011:43:170
2403299130,2cyclictest0-21swapper/011:36:160
2403299130,12cyclictest0-21swapper/011:05:260
2403299130,12cyclictest0-21swapper/011:02:560
2403299130,12cyclictest0-21swapper/010:36:470
2403299130,12cyclictest0-21swapper/010:16:160
2403299130,12cyclictest0-21swapper/008:51:030
2403299130,11cyclictest20439-21munin-node0
2403299130,11cyclictest14562-21ssh10:55:080
2403599129,2cyclictest15333-21copy12:35:023
2403599129,2cyclictest0-21swapper/310:30:033
2403599129,2cyclictest0-21swapper/309:50:043
2403599129,2cyclictest0-21swapper/309:10:043
2403599129,2cyclictest0-21swapper/308:54:343
2403599129,2cyclictest0-21swapper/308:20:033
2403599127,3cyclictest7784-21ntp_states11:20:193
2403599120,2cyclictest0-21swapper/311:27:553
2403599120,2cyclictest0-21swapper/309:35:523
2403599120,2cyclictest0-21swapper/308:15:173
2403599120,11cyclictest0-21swapper/311:11:423
2403599120,11cyclictest0-21swapper/310:55:183
2403599120,11cyclictest0-21swapper/308:36:043
2403599120,11cyclictest0-21swapper/308:31:033
2403499129,2cyclictest31030-21kworker/u8:107:30:052
2403499120,2cyclictest0-21swapper/207:19:042
2403499120,11cyclictest0-21swapper/207:55:152
2403399129,2cyclictest0-21swapper/112:25:231
2403399129,2cyclictest0-21swapper/109:46:571
2403399129,2cyclictest0-21swapper/108:10:131
2403399122,7cyclictest0-21swapper/107:17:011
2403399121,9cyclictest20183-21munin-run08:20:011
2403399121,9cyclictest0-21swapper/112:15:191
2403399120,2cyclictest0-21swapper/110:43:241
2403399120,2cyclictest0-21swapper/108:05:161
2403399120,11cyclictest0-21swapper/109:05:171
2403399120,11cyclictest0-21swapper/109:00:391
2403399120,11cyclictest0-21swapper/108:55:201
2403399120,11cyclictest0-21swapper/107:55:521
2403399120,11cyclictest0-21swapper/107:25:011
2403399120,11cyclictest0-21swapper/107:21:041
2403399120,10cyclictest0-21swapper/108:25:381
2403299129,2cyclictest0-21swapper/011:45:380
2403299129,2cyclictest0-21swapper/009:50:060
2403299129,2cyclictest0-21swapper/009:25:070
2403299129,2cyclictest0-21swapper/008:30:170
2403299129,2cyclictest0-21swapper/008:06:020
2403299129,2cyclictest0-21swapper/008:01:010
2403299120,2cyclictest0-21swapper/012:02:090
2403299120,2cyclictest0-21swapper/007:35:120
2403299120,11cyclictest0-21swapper/010:25:210
2403299120,11cyclictest0-21swapper/009:36:070
2403299120,11cyclictest0-21swapper/007:10:400
65952110,2sleep20-21swapper/210:13:512
2403599118,2cyclictest0-21swapper/308:03:253
2403599112,5cyclictest0-21swapper/307:40:593
2403599110,10cyclictest0-21swapper/308:47:223
2403499112,7cyclictest0-21swapper/212:34:012
2403399116,3cyclictest2565-21wc07:35:161
2403399113,6cyclictest0-21swapper/107:48:261
2403399110,9cyclictest0-21swapper/108:30:181
2403299118,2cyclictest0-21swapper/008:55:190
2403299118,2cyclictest0-21swapper/007:30:180
2403299110,3cyclictest6097-21latency_hist07:45:000
2403299110,10cyclictest0-21swapper/008:44:390
87242100,1sleep011-21rcuc/007:50:140
2403599107,2cyclictest0-21swapper/307:10:513
2403599105,3cyclictest29383-21fgrep07:21:033
2403499107,2cyclictest0-21swapper/210:36:322
2403299107,2cyclictest31030-21kworker/u8:107:26:040
2403299100,9cyclictest26585-21sed07:15:150
2403299100,9cyclictest0-21swapper/009:04:570
2403299100,9cyclictest0-21swapper/008:48:560
240359994,3cyclictest9488-21swap07:51:023
240359994,3cyclictest29926-21sendmail-mta07:25:123
240359994,3cyclictest274-21jbd2/sda1-808:05:173
240359994,3cyclictest27420-21python07:16:023
240349994,3cyclictest26465-21stty11:40:132
240329996,2cyclictest0-21swapper/007:45:160
240329992,6cyclictest0-21swapper/007:23:210
240329990,2cyclictest0-21swapper/008:15:130
240359983,3cyclictest41602chrt09:00:083
240329980,7cyclictest22534-21aten2.4_r3power08:25:100
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional