You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-09 - 17:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Sat May 09, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
15810211894,19sleep00-21swapper/007:09:330
1755521150,1sleep217553-21grep08:31:032
15756211395,12sleep30-21swapper/307:08:523
15802210180,15sleep20-21swapper/207:09:272
15801210081,14sleep10-21swapper/107:09:261
134092790,0sleep10-21swapper/110:34:211
83102660,0sleep20-21swapper/209:18:262
181242260,1sleep30-21swapper/308:35:003
310242240,0sleep00-21swapper/012:37:500
192572240,0sleep00-21swapper/007:16:000
1587399210,2cyclictest0-21swapper/112:20:051
15873991913,5cyclictest9667-21kworker/u8:011:42:051
73492180,1sleep30-21swapper/309:51:543
73492180,1sleep30-21swapper/309:51:533
1587499183,13cyclictest32184-21diskmemload09:56:092
1587499183,13cyclictest0-21swapper/210:25:202
15873991815,2cyclictest30118-21kworker/u8:012:05:051
70832170,1sleep10-21swapper/109:51:281
70832170,1sleep10-21swapper/109:51:271
1587599171,14cyclictest18288-21sh09:29:303
1587499173,13cyclictest20846-21ssh12:26:102
1587499172,3cyclictest0-21swapper/207:40:122
1587499171,14cyclictest0-21swapper/211:25:142
1587299173,2cyclictest12660-21df_abs08:20:140
1587299173,12cyclictest101ktimersoftd/012:02:500
1587599163,11cyclictest3728-21runrttasks11:45:313
1587499162,4cyclictest0-21swapper/210:56:482
15874991612,3cyclictest0-21swapper/211:34:312
15874991611,4cyclictest23782-21sh10:45:122
1587499160,14cyclictest24199-21latency09:35:172
1587299161,2cyclictest26902-21ssh09:38:400
15872991610,4cyclictest6234-21munin-node0
1587599151,8cyclictest4649-21ssh11:34:593
1587599151,3cyclictest4072-21ssh09:49:133
1587599151,3cyclictest4072-21ssh09:49:123
1587499153,10cyclictest0-21swapper/211:42:072
1587499152,12cyclictest0-21swapper/212:31:222
1587499151,12cyclictest1582-21ssh09:11:012
1587499151,12cyclictest0-21swapper/211:50:162
15873991512,2cyclictest7411-21kworker/u8:009:22:041
15873991512,2cyclictest14262-21kworker/u8:109:40:051
15873991512,2cyclictest12309-21kworker/u8:010:35:041
1587399151,12cyclictest2052-21grep10:56:041
1587399151,12cyclictest0-21swapper/110:50:531
15873991510,3cyclictest3728-21runrttasks08:20:121
1587399150,11cyclictest0-21swapper/110:28:251
1587299152,2cyclictest101ktimersoftd/009:30:150
1587299152,2cyclictest0-21swapper/011:05:480
1587299151,2cyclictest101ktimersoftd/010:15:410
15872991512,2cyclictest101ktimersoftd/010:41:450
1587299151,12cyclictest101ktimersoftd/012:12:580
1587299151,12cyclictest101ktimersoftd/011:33:360
1587299151,12cyclictest101ktimersoftd/010:28:540
1587299150,13cyclictest29663-21sensors_fan09:41:010
1587299150,13cyclictest0-21swapper/011:57:200
1587599142,6cyclictest0-21swapper/309:15:003
15875991411,2cyclictest0-21swapper/310:50:113
15875991411,2cyclictest0-21swapper/310:35:573
15875991411,2cyclictest0-21swapper/309:33:403
15875991410,2cyclictest0-21swapper/310:30:103
1587599140,3cyclictest17826-21seq10:04:023
1587599140,13cyclictest0-21swapper/311:38:203
1587599140,13cyclictest0-21swapper/309:12:543
1587599140,12cyclictest0-21swapper/311:07:003
1587599140,12cyclictest0-21swapper/310:45:593
1587599140,12cyclictest0-21swapper/309:55:193
1587499143,10cyclictest0-21swapper/212:02:132
1587499141,12cyclictest0-21swapper/212:06:232
15874991410,3cyclictest0-21swapper/210:09:352
1587499140,3cyclictest0-21swapper/208:35:202
1587399141,3cyclictest26357-21munin-node1
15873991411,2cyclictest14262-21kworker/u8:109:34:041
1587399141,11cyclictest24618-21cut09:35:301
15873991410,2cyclictest0-21swapper/112:25:501
1587399140,3cyclictest0-21swapper/110:17:381
1587399140,2cyclictest0-21swapper/111:32:051
1587399140,12cyclictest3798-21ssh10:23:471
1587399140,12cyclictest0-21swapper/107:30:201
1587399140,10cyclictest0-21swapper/112:10:371
1587299142,11cyclictest11559-21ssh10:31:170
1587299141,2cyclictest22721-21ssh11:54:180
15872991411,2cyclictest3861-21ssh09:48:520
15872991411,2cyclictest3861-21ssh09:48:510
15872991411,2cyclictest21426-21ssh11:17:210
15872991411,2cyclictest19442-1kworker/u9:210:09:450
15872991411,2cyclictest101ktimersoftd/012:21:320
15872991411,2cyclictest101ktimersoftd/010:22:320
15872991411,2cyclictest101ktimersoftd/009:22:560
1587299140,2cyclictest0-21swapper/010:46:590
1587299140,12cyclictest0-21swapper/012:30:330
79492130,2sleep10-21swapper/111:02:511
1587599132,6cyclictest0-21swapper/312:20:013
1587599132,6cyclictest0-21swapper/310:10:003
15875991310,2cyclictest0-21swapper/312:38:353
15875991310,2cyclictest0-21swapper/311:21:503
15875991310,2cyclictest0-21swapper/311:15:313
15875991310,2cyclictest0-21swapper/311:13:203
15875991310,2cyclictest0-21swapper/311:00:433
15875991310,2cyclictest0-21swapper/310:26:433
15875991310,2cyclictest0-21swapper/310:10:163
15875991310,2cyclictest0-21swapper/309:44:473
15875991310,2cyclictest0-21swapper/308:00:153
1587599130,2cyclictest0-21swapper/312:08:113
1587599130,2cyclictest0-21swapper/311:50:193
1587599130,2cyclictest0-21swapper/310:43:513
1587599130,2cyclictest0-21swapper/308:36:033
1587599130,2cyclictest0-21swapper/308:25:163
1587599130,12cyclictest0-21swapper/311:57:203
1587599130,12cyclictest0-21swapper/310:56:303
1587599130,12cyclictest0-21swapper/310:22:053
1587599130,12cyclictest0-21swapper/309:00:113
1587599130,12cyclictest0-21swapper/307:40:173
1587599130,11cyclictest0-21swapper/311:42:573
1587499139,3cyclictest0-21swapper/210:23:212
1587499136,5cyclictest9662-21aten2.4_r3power11:05:122
1587499136,5cyclictest9638-21sh12:15:112
1587499136,5cyclictest9635-21aten2.4_r3power10:30:112
1587499136,5cyclictest5796-21ssh11:00:162
1587499136,5cyclictest32726-21expr07:50:132
1587499136,5cyclictest30274-21munin-node2
1587499136,5cyclictest29167-21chrt10:50:342
1587499136,5cyclictest25233-21ntp_kernel_pll_08:50:162
1587499136,5cyclictest23964-21awk11:20:142
1587499136,5cyclictest22456-21expr07:25:132
1587499136,5cyclictest20708-21awk09:31:022
1587499136,5cyclictest16125-21grep11:46:022
1587499136,5cyclictest16030-21head10:36:042
1587499136,5cyclictest15653-21ssh12:20:472
1587499136,5cyclictest14495-21df_abs11:10:112
1587499136,5cyclictest10192-21fschecks_time09:20:152
1587499135,6cyclictest5298-21cpuspeed_turbos12:10:122
1587499134,8cyclictest0-21swapper/211:15:402
1587499132,2cyclictest32184-21diskmemload09:25:282
1587499131,4cyclictest0-21swapper/210:16:502
1587499131,2cyclictest0-21swapper/209:40:022
1587499131,11cyclictest0-21swapper/210:00:482
15874991310,2cyclictest0-21swapper/208:11:012
1587499130,2cyclictest0-21swapper/208:55:102
1587499130,12cyclictest0-21swapper/210:40:162
1587399131,3cyclictest32184-21diskmemload12:00:171
15873991310,2cyclictest14153-21apt-get11:10:091
15873991310,2cyclictest0-21swapper/112:33:291
15873991310,2cyclictest0-21swapper/112:18:141
15873991310,2cyclictest0-21swapper/111:06:421
15873991310,2cyclictest0-21swapper/110:45:481
1587399130,2cyclictest11465-21diskmemload09:56:051
1587399130,2cyclictest0-21swapper/112:39:171
1587399130,2cyclictest0-21swapper/111:35:381
1587399130,2cyclictest0-21swapper/111:23:591
15872991310,2cyclictest3728-21runrttasks08:25:180
15872991310,2cyclictest101ktimersoftd/012:06:420
15872991310,2cyclictest101ktimersoftd/010:36:450
15872991310,2cyclictest101ktimersoftd/008:35:520
15872991310,2cyclictest0-21swapper/012:27:120
15872991310,2cyclictest0-21swapper/011:40:100
15872991310,2cyclictest0-21swapper/011:36:190
15872991310,2cyclictest0-21swapper/011:12:390
15872991310,2cyclictest0-21swapper/010:50:020
15872991310,2cyclictest0-21swapper/010:10:250
15872991310,2cyclictest0-21swapper/010:00:550
15872991310,2cyclictest0-21swapper/009:56:090
15872991310,2cyclictest0-21swapper/009:52:150
15872991310,2cyclictest0-21swapper/009:52:140
15872991310,2cyclictest0-21swapper/009:26:460
15872991310,2cyclictest0-21swapper/009:06:020
15872991310,2cyclictest0-21swapper/007:20:290
1587299130,2cyclictest0-21swapper/011:20:400
1587299130,2cyclictest0-21swapper/010:56:230
1587299130,2cyclictest0-21swapper/009:16:220
1587299130,12cyclictest101ktimersoftd/008:16:240
1587299130,12cyclictest0-21swapper/011:46:070
1587299130,12cyclictest0-21swapper/011:29:340
1587299130,12cyclictest0-21swapper/011:02:520
147702130,2sleep10-21swapper/110:00:151
1587599129,2cyclictest0-21swapper/312:11:473
1587599129,2cyclictest0-21swapper/309:21:283
1587599129,2cyclictest0-21swapper/307:50:513
1587599127,3cyclictest27659-21copy11:25:013
1587599122,7cyclictest0-21swapper/308:08:023
1587599122,6cyclictest0-21swapper/309:00:013
1587599122,6cyclictest0-21swapper/307:36:003
1587599120,2cyclictest0-21swapper/312:25:483
1587599120,2cyclictest0-21swapper/312:02:143
1587599120,11cyclictest0-21swapper/312:31:023
1587599120,11cyclictest0-21swapper/312:21:183
1587599120,11cyclictest0-21swapper/310:15:293
1587599120,11cyclictest0-21swapper/309:35:583
1587599120,11cyclictest0-21swapper/308:20:183
1587599120,11cyclictest0-21swapper/307:15:173
1587499129,2cyclictest18128-21apt-get07:15:112
1587499126,5cyclictest22344-21munin-node2
1587499126,4cyclictest6738-21grep08:05:162
1587499126,4cyclictest5195-21grep09:50:132
1587499126,4cyclictest5195-21grep09:50:122
1587499126,4cyclictest5042-21cut11:35:112
1587499126,4cyclictest30450-21cut09:05:132
1587499126,4cyclictest28647-21cut12:35:142
1587499126,4cyclictest28385-21munin-node2
1587499126,4cyclictest24758-21perl07:30:162
1587499126,4cyclictest23612-21cut10:10:142
1587499126,4cyclictest14366-21aten2.4_r3power08:25:132
1587499126,4cyclictest0-21swapper/207:35:112
1587499126,4cyclictest0-21swapper/207:20:132
1587499125,5cyclictest32718-21aten2.4_r3power09:45:122
1587499125,5cyclictest32718-21aten2.4_r3power09:45:112
1587499125,5cyclictest23603-21aten2.4_r3power11:55:132
1587499125,5cyclictest10337-21aten2.4_r3power08:15:122
1587499125,5cyclictest0-21swapper/208:20:172
1587499125,5cyclictest0-21swapper/208:00:162
1587499125,5cyclictest0-21swapper/207:10:102
1587399129,2cyclictest32184-21diskmemload11:55:451
1587399129,2cyclictest0-21swapper/111:51:251
1587399129,2cyclictest0-21swapper/111:16:551
1587399129,2cyclictest0-21swapper/110:41:141
1587399128,2cyclictest1772-21apt-get07:55:051
1587399128,2cyclictest0-21swapper/108:45:131
1587399128,2cyclictest0-21swapper/108:35:171
1587399121,9cyclictest32442-21apt-get07:50:111
1587399121,9cyclictest0-21swapper/108:15:151
1587399121,3cyclictest0-21swapper/109:06:021
1587399120,3cyclictest0-21swapper/108:04:591
1587399120,11cyclictest0-21swapper/111:45:121
1587399120,11cyclictest0-21swapper/111:26:151
1587399120,11cyclictest0-21swapper/110:14:181
1587299129,2cyclictest101ktimersoftd/007:35:140
1587299129,2cyclictest0-21swapper/008:10:130
1587299129,2cyclictest0-21swapper/007:55:010
1587299129,2cyclictest0-21swapper/007:10:180
1587299127,4cyclictest0-21swapper/007:30:130
1587299120,2cyclictest0-21swapper/007:46:020
1587299120,11cyclictest101ktimersoftd/007:41:040
1587299120,11cyclictest0-21swapper/012:15:010
1587299120,11cyclictest0-21swapper/009:10:150
36622110,2sleep10-21swapper/109:13:461
1587599118,2cyclictest0-21swapper/308:40:243
1587599116,3cyclictest25628-21unixbench_singl07:31:053
1587599111,5cyclictest0-21swapper/308:00:003
1587599110,10cyclictest0-21swapper/307:14:243
1587499116,4cyclictest3649-21snmpd07:55:072
1587499115,4cyclictest0-21swapper/208:40:102
1587399118,2cyclictest0-21swapper/108:30:391
1587399117,2cyclictest0-21swapper/107:11:001
1587399116,3cyclictest18719-21munin-node1
1587399111,3cyclictest32663-21munin-node1
1587399111,3cyclictest32663-21munin-node1
1587399111,3cyclictest0-21swapper/108:10:161
1587399110,9cyclictest28269-21munin-node1
1587399110,9cyclictest0-21swapper/109:25:121
1587399110,9cyclictest0-21swapper/107:45:151
1587399110,9cyclictest0-21swapper/107:35:151
1587399110,9cyclictest0-21swapper/107:15:181
1587399110,3cyclictest0-21swapper/107:20:131
1587299118,2cyclictest0-21swapper/008:56:020
1587299118,2cyclictest0-21swapper/007:26:010
1587599107,2cyclictest0-21swapper/308:45:133
1587599107,2cyclictest0-21swapper/308:16:053
1587599107,2cyclictest0-21swapper/307:21:013
1587599106,3cyclictest24745-21diskstats08:50:123
1587599105,3cyclictest31780-21sshd07:46:243
1587599100,7cyclictest0-21swapper/307:25:013
1587399107,2cyclictest0-21swapper/108:40:181
1587399101,7cyclictest24349-21munin-node1
1587399101,6cyclictest0-21swapper/107:27:421
1587399100,8cyclictest6234-21munin-node1
1587399100,8cyclictest0-21swapper/109:00:151
1587299102,6cyclictest17421-21tr08:31:000
158759994,3cyclictest8248-21aten2.4_r3power08:10:113
158759994,3cyclictest30714-21df_abs09:05:143
158739996,2cyclictest0-21swapper/108:26:021
158739994,3cyclictest3157-21lldpd09:15:131
158729996,2cyclictest101ktimersoftd/008:53:010
158729994,3cyclictest4437-21tr08:00:130
158729990,8cyclictest274-21jbd2/sda1-809:00:160
158729990,8cyclictest0-21swapper/007:52:070
158729985,2cyclictest101ktimersoftd/008:45:100
158729980,2cyclictest0-21swapper/008:40:340
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional