You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-12 - 14:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Wed Aug 12, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1105321530,2sleep23195299cyclictest12:25:012
311932117106,6sleep30-21swapper/307:05:463
30704211593,15sleep00-21swapper/007:05:160
31716210989,15sleep20-21swapper/207:07:222
31191210885,17sleep10-21swapper/107:05:451
209542830,1sleep320957-21latency08:00:173
31950993616,18cyclictest0-21swapper/010:50:130
157982280,1sleep2301ktimersoftd/211:21:032
31952992522,2cyclictest779-21kworker/u8:011:13:052
31952992522,2cyclictest29151-21kworker/u8:212:30:042
31952992522,2cyclictest22593-21kworker/u8:109:51:042
31952992421,2cyclictest8690-21kworker/u8:012:13:042
31952992421,2cyclictest8690-21kworker/u8:011:57:042
31952992421,2cyclictest7107-21kworker/u8:111:34:052
31952992421,2cyclictest3622-21kworker/u8:111:45:042
31952992421,2cyclictest32375-21kworker/u8:010:07:042
31952992421,2cyclictest24433-21kworker/u8:209:19:042
31952992421,2cyclictest24336-21kworker/u8:110:43:042
31952992421,2cyclictest24336-21kworker/u8:110:34:042
31952992421,2cyclictest12924-21kworker/u8:211:09:042
31951992420,2cyclictest11303-21kworker/u8:012:27:041
3195399231,20cyclictest13827-21ssh09:40:103
3195399231,20cyclictest13827-21ssh09:40:103
31952992320,2cyclictest7107-21kworker/u8:111:27:052
31952992320,2cyclictest6137-21kworker/u8:009:35:042
31952992320,2cyclictest6137-21kworker/u8:009:35:042
31952992320,2cyclictest32375-21kworker/u8:010:11:052
31952992320,2cyclictest24336-21kworker/u8:110:36:062
31952992320,2cyclictest23693-21kworker/u8:112:05:042
31952992320,2cyclictest22668-21kworker/u8:108:07:052
31952992320,2cyclictest2075-21kworker/u8:109:30:052
31952992320,2cyclictest12279-21kworker/u8:110:15:042
3195299230,18cyclictest0-21swapper/211:15:042
31952992219,2cyclictest9604-21kworker/u8:108:56:062
31952992219,2cyclictest7948-21kworker/u8:107:44:022
31952992219,2cyclictest6137-21kworker/u8:009:25:042
31952992219,2cyclictest30973-21kworker/u8:108:40:052
31952992219,2cyclictest29151-21kworker/u8:212:16:052
31952992219,2cyclictest16507-21kworker/u8:009:47:052
31952992219,2cyclictest16507-21kworker/u8:009:43:052
31952992219,2cyclictest16507-21kworker/u8:009:43:042
31951992219,2cyclictest14675-21kworker/u8:212:00:041
250092220,0sleep20-21swapper/210:24:352
3195299212,2cyclictest0-21swapper/210:50:042
31952992118,2cyclictest30973-21kworker/u8:108:27:042
31952992118,2cyclictest22593-21kworker/u8:110:04:022
31952992118,2cyclictest14212-21kworker/u8:207:56:052
31952992118,2cyclictest14212-21kworker/u8:207:49:042
31951992118,2cyclictest8690-21kworker/u8:011:49:041
31951992118,2cyclictest6137-21kworker/u8:009:32:051
31951992118,2cyclictest24336-21kworker/u8:110:33:041
3195199210,19cyclictest0-21swapper/110:55:111
3195299200,15cyclictest0-21swapper/207:52:052
31951992017,2cyclictest7107-21kworker/u8:111:32:041
31951992017,2cyclictest4047-21kworker/u8:010:46:051
31951992017,2cyclictest24433-21kworker/u8:209:23:051
31951992017,2cyclictest22593-21kworker/u8:109:59:041
31952991916,2cyclictest32159-21kworker/u8:007:12:042
31952991916,2cyclictest27987-21kworker/u8:208:49:042
3195299190,2cyclictest0-21swapper/212:22:012
3195299190,2cyclictest0-21swapper/211:04:052
3195299190,2cyclictest0-21swapper/210:25:042
3195299190,18cyclictest0-21swapper/211:36:022
31951991916,2cyclictest8915-21kworker/u8:209:53:041
31951991916,2cyclictest29151-21kworker/u8:212:11:041
31951991916,2cyclictest24336-21kworker/u8:110:40:051
3195199190,2cyclictest0-21swapper/111:53:051
3195199190,2cyclictest0-21swapper/109:25:111
3195199190,17cyclictest16993-21kworker/1:208:05:131
3195199190,17cyclictest0-21swapper/108:35:111
152292190,0sleep10-21swapper/107:46:051
31952991815,2cyclictest22668-21kworker/u8:108:18:052
3195299180,2cyclictest0-21swapper/211:51:052
3195299180,2cyclictest0-21swapper/209:02:042
3195299180,17cyclictest0-21swapper/208:39:042
31951991815,2cyclictest779-21kworker/u8:011:07:041
31951991815,2cyclictest22593-21kworker/u8:110:00:021
31951991815,2cyclictest2075-21kworker/u8:109:39:041
31951991815,2cyclictest2075-21kworker/u8:109:39:041
31951991815,2cyclictest18261-21kworker/u8:112:38:041
31951991815,2cyclictest18071-21kworker/u8:011:28:021
31951991815,2cyclictest16267-21kworker/u8:109:16:051
3195099180,16cyclictest0-21swapper/012:10:120
31953991712,3cyclictest0-21swapper/310:01:023
3195399171,13cyclictest0-21swapper/312:31:033
3195299170,2cyclictest0-21swapper/212:01:052
31951991714,2cyclictest779-21kworker/u8:011:18:051
31951991714,2cyclictest32375-21kworker/u8:010:17:041
31951991714,2cyclictest24336-21kworker/u8:110:38:021
31951991714,2cyclictest24336-21kworker/u8:110:27:051
31951991714,2cyclictest12279-21kworker/u8:110:14:051
3195199170,13cyclictest0-21swapper/111:24:041
31953991611,3cyclictest14574-21ssh11:55:093
31951991613,2cyclictest7948-21kworker/u8:107:17:051
31951991613,2cyclictest3622-21kworker/u8:111:43:051
31951991613,2cyclictest30973-21kworker/u8:108:42:051
31951991613,2cyclictest29151-21kworker/u8:212:33:051
31951991613,2cyclictest27987-21kworker/u8:208:24:051
31951991613,2cyclictest16267-21kworker/u8:109:12:011
31951991613,2cyclictest14212-21kworker/u8:207:55:051
31951991613,2cyclictest12924-21kworker/u8:211:11:041
31951991613,2cyclictest12924-21kworker/u8:210:52:051
31951991612,2cyclictest32375-21kworker/u8:010:20:041
3195399151,12cyclictest0-21swapper/309:30:163
31953991510,3cyclictest0-21swapper/311:20:053
3195399150,3cyclictest0-21swapper/312:39:113
3195399150,13cyclictest2849-21rs:main3
3195399150,13cyclictest0-21swapper/308:05:053
3195399150,12cyclictest7159-21ssh11:12:073
3195199151,3cyclictest8964-21cut07:30:201
3195199151,3cyclictest0-21swapper/112:23:521
31951991512,2cyclictest8690-21kworker/u8:011:58:041
31951991512,2cyclictest30973-21kworker/u8:108:34:051
31951991512,2cyclictest27987-21kworker/u8:208:26:041
31951991512,2cyclictest26993-21kworker/u8:111:03:051
31951991512,2cyclictest10004-21kworker/u8:008:00:041
31950991510,3cyclictest7405-21ps12:20:190
3195099150,13cyclictest7264-21smartctl08:46:010
3195099150,13cyclictest0-21swapper/009:55:500
3195099150,12cyclictest0-21swapper/007:10:130
31953991411,2cyclictest0-21swapper/312:14:283
3195399140,3cyclictest21920-21ssh12:01:553
3195399140,12cyclictest19024-21cpuspeed_turbos11:25:143
3195399140,12cyclictest15943-21diskmemload12:15:153
3195399140,12cyclictest0-21swapper/312:28:533
3195399140,12cyclictest0-21swapper/311:46:033
3195399140,12cyclictest0-21swapper/309:20:163
3195299142,6cyclictest0-21swapper/210:50:002
3195299142,6cyclictest0-21swapper/208:15:002
3195299142,6cyclictest0-21swapper/207:39:592
31951991411,2cyclictest9604-21kworker/u8:108:58:051
31951991411,2cyclictest8690-21kworker/u8:012:18:021
31951991411,2cyclictest7948-21kworker/u8:107:42:051
31951991411,2cyclictest2075-21kworker/u8:109:40:061
31951991411,2cyclictest2075-21kworker/u8:109:40:051
31951991411,2cyclictest12177-21kworker/u8:209:08:051
31951991411,2cyclictest0-21swapper/111:38:271
3195199141,11cyclictest28083-21latency_hist08:19:591
3195199140,12cyclictest8659-21cut08:50:141
3195199140,12cyclictest0-21swapper/110:08:371
3195099141,2cyclictest15849-21ssh10:15:130
31950991411,2cyclictest5309-21apt-get11:45:110
31950991411,2cyclictest0-21swapper/011:33:400
31950991411,2cyclictest0-21swapper/010:30:010
31950991410,2cyclictest13116-21vmstat12:26:020
31950991410,2cyclictest0-21swapper/010:40:000
3195099140,2cyclictest29961-21ssh09:23:410
3195099140,12cyclictest30819-21fschecks_time08:25:150
3195099140,12cyclictest17222-21ssh11:23:000
3195099140,12cyclictest0-21swapper/012:00:140
3195099140,12cyclictest0-21swapper/010:43:080
3195099140,12cyclictest0-21swapper/009:12:350
3195399132,6cyclictest0-21swapper/310:54:593
3195399132,6cyclictest0-21swapper/308:35:013
3195399132,6cyclictest0-21swapper/308:15:003
3195399131,7cyclictest0-21swapper/309:55:003
31953991310,2cyclictest0-21swapper/311:40:463
31953991310,2cyclictest0-21swapper/311:31:563
31953991310,2cyclictest0-21swapper/311:16:083
31953991310,2cyclictest0-21swapper/310:55:113
31953991310,2cyclictest0-21swapper/310:36:023
31953991310,2cyclictest0-21swapper/310:20:223
31953991310,2cyclictest0-21swapper/309:35:513
31953991310,2cyclictest0-21swapper/309:35:503
31953991310,2cyclictest0-21swapper/308:15:173
31953991310,2cyclictest0-21swapper/307:36:003
3195399130,2cyclictest0-21swapper/311:37:593
3195399130,2cyclictest0-21swapper/310:13:033
3195399130,2cyclictest0-21swapper/309:45:513
3195399130,2cyclictest0-21swapper/309:14:263
3195399130,12cyclictest12200-21ssh11:51:493
3195399130,12cyclictest0-21swapper/310:17:383
3195399130,12cyclictest0-21swapper/309:17:573
3195299138,3cyclictest0-21swapper/208:21:032
31952991310,2cyclictest0-21swapper/209:55:112
31952991310,2cyclictest0-21swapper/207:21:032
3195199132,6cyclictest0-21swapper/107:19:591
31951991310,2cyclictest32159-21kworker/u8:007:14:041
31951991310,2cyclictest27987-21kworker/u8:208:46:041
31951991310,2cyclictest0-21swapper/109:00:101
3195199130,2cyclictest0-21swapper/112:05:491
31950991310,2cyclictest6177-21ssh11:11:000
31950991310,2cyclictest15943-21diskmemload11:43:010
31950991310,2cyclictest0-21swapper/012:34:130
31950991310,2cyclictest0-21swapper/011:01:140
31950991310,2cyclictest0-21swapper/010:20:100
31950991310,2cyclictest0-21swapper/008:06:030
3195099130,2cyclictest9859-21fschecks_time11:15:150
3195099130,2cyclictest18333-21ssh09:44:510
3195099130,2cyclictest18333-21ssh09:44:500
3195099130,2cyclictest0-21swapper/011:26:050
3195099130,12cyclictest0-21swapper/012:18:150
3195099130,12cyclictest0-21swapper/011:57:200
3195099130,11cyclictest0-21swapper/010:57:550
3195099130,11cyclictest0-21swapper/010:03:300
3195099130,11cyclictest0-21swapper/009:32:450
3195099130,11cyclictest0-21swapper/007:40:170
3195399129,2cyclictest0-21swapper/311:05:133
3195399129,2cyclictest0-21swapper/310:30:553
3195399129,2cyclictest0-21swapper/310:25:273
3195399129,2cyclictest0-21swapper/310:07:543
3195399129,2cyclictest0-21swapper/307:45:183
3195399127,3cyclictest29296-21munin-node3
3195399123,5cyclictest0-21swapper/307:31:013
3195399122,7cyclictest0-21swapper/308:47:583
3195399120,2cyclictest0-21swapper/312:20:423
3195399120,2cyclictest0-21swapper/310:48:373
3195399120,11cyclictest0-21swapper/312:05:143
3195399120,11cyclictest0-21swapper/310:42:343
3195399120,11cyclictest0-21swapper/309:28:023
3195399120,11cyclictest0-21swapper/308:55:393
3195399120,11cyclictest0-21swapper/307:25:133
3195299129,2cyclictest24530-21ssh10:56:032
3195299129,2cyclictest0-21swapper/212:36:022
3195299129,2cyclictest0-21swapper/211:40:052
3195299120,2cyclictest0-21swapper/209:21:082
3195299120,2cyclictest0-21swapper/208:00:312
3195299120,11cyclictest0-21swapper/209:12:282
3195199121,9cyclictest15943-21diskmemload09:45:131
3195199120,2cyclictest0-21swapper/107:25:131
3195199120,11cyclictest0-21swapper/107:50:181
3195099129,2cyclictest0-21swapper/011:50:330
3195099129,2cyclictest0-21swapper/011:07:400
3195099129,2cyclictest0-21swapper/010:45:240
3195099129,2cyclictest0-21swapper/010:06:130
3195099129,2cyclictest0-21swapper/009:45:150
3195099129,2cyclictest0-21swapper/009:35:360
3195099129,2cyclictest0-21swapper/009:35:350
3195099129,2cyclictest0-21swapper/008:35:180
3195099129,2cyclictest0-21swapper/008:10:120
3195099122,7cyclictest0-21swapper/007:45:010
3195099120,2cyclictest0-21swapper/009:15:140
3195099120,2cyclictest0-21swapper/008:21:040
3195099120,11cyclictest0-21swapper/012:05:190
3195099120,11cyclictest0-21swapper/010:10:170
3195099120,11cyclictest0-21swapper/009:50:170
3195099120,11cyclictest0-21swapper/009:27:330
3195099120,11cyclictest0-21swapper/009:05:150
3195099120,11cyclictest0-21swapper/008:55:130
3195099120,10cyclictest0-21swapper/008:15:110
317492120,8sleep00-21swapper/010:30:310
3195399113,5cyclictest0-21swapper/309:06:013
3195399110,2cyclictest0-21swapper/308:43:473
3195299118,2cyclictest0-21swapper/207:29:392
3195299112,7cyclictest0-21swapper/207:34:592
3195199117,2cyclictest24278-21munin-node1
3195199110,9cyclictest10010-21munin-node1
3195099118,2cyclictest0-21swapper/012:38:230
3195099111,6cyclictest0-21swapper/008:45:000
3195099111,5cyclictest0-21swapper/007:20:000
3195099110,10cyclictest0-21swapper/011:35:540
3195099110,10cyclictest0-21swapper/008:31:440
3195399107,2cyclictest0-21swapper/308:21:063
3195399102,5cyclictest0-21swapper/307:11:013
3195399101,5cyclictest0-21swapper/307:40:113
3195399100,9cyclictest0-21swapper/309:02:443
3195299107,2cyclictest0-21swapper/208:51:022
3195099105,3cyclictest274-21jbd2/sda1-807:29:590
3195099102,6cyclictest0-21swapper/007:23:010
3195099101,7cyclictest0-21swapper/008:01:040
3195099100,7cyclictest0-21swapper/007:37:580
8854290,6sleep00-21swapper/007:30:200
319539994,3cyclictest9746-21sendmail-mta08:53:163
319539994,3cyclictest3833-21aten2.4_r3power07:20:123
319539994,3cyclictest3739-21cron08:40:003
319539994,3cyclictest30935-21cut08:25:163
319539994,3cyclictest2492-21load07:15:173
319539994,3cyclictest16419-21sed07:50:143
319529996,2cyclictest0-21swapper/207:15:182
319529994,3cyclictest14192-21basename09:05:122
319529990,8cyclictest0-21swapper/208:32:502
319509992,6cyclictest0-21swapper/009:00:590
319509990,7cyclictest0-21swapper/007:57:590
319539983,3cyclictest18729-21perl07:55:123
319509985,2cyclictest0-21swapper/008:52:580
319509983,3cyclictest16340-21grep07:50:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional