You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-02 - 01:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Tue Jun 02, 2026 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
23642114103,6sleep30-21swapper/319:08:503
2420210580,6sleep20-21swapper/219:09:332
2239210577,6sleep00-21swapper/019:07:150
700210087,6sleep10-21swapper/119:05:121
115732750,0sleep10-21swapper/119:30:151
248499381,19cyclictest21426-21ssh00:00:113
248199370,18cyclictest0-21swapper/020:20:110
2482992914,3cyclictest0-21swapper/100:00:111
248499221,19cyclictest0-21swapper/321:45:123
248199220,20cyclictest0-21swapper/019:50:120
237902220,0sleep00-21swapper/021:15:030
56652210,0sleep20-21swapper/223:10:132
248299211,2cyclictest0-21swapper/122:20:121
248299210,2cyclictest0-21swapper/120:50:101
248399200,2cyclictest0-21swapper/221:50:112
248199200,2cyclictest0-21swapper/019:45:120
248499190,2cyclictest0-21swapper/322:20:123
248399190,1cyclictest0-21swapper/223:05:122
248399180,2cyclictest0-21swapper/219:25:112
248199180,2cyclictest0-21swapper/019:25:100
2483991714,2cyclictest475-21kworker/u8:223:44:042
2483991714,2cyclictest21143-21kworker/u8:122:59:042
248399170,3cyclictest0-21swapper/222:21:042
2481991712,3cyclictest0-21swapper/021:40:080
2483991613,2cyclictest4968-21kworker/u8:021:49:042
2483991613,2cyclictest32300-21kworker/u8:221:26:042
2483991613,2cyclictest28558-21kworker/u8:219:24:042
2483991613,2cyclictest2691-21kworker/u8:119:56:042
2483991613,2cyclictest20751-21kworker/u8:200:38:012
2483991613,2cyclictest16989-21kworker/u8:221:17:042
248399160,11cyclictest0-21swapper/200:32:042
248299161,3cyclictest0-21swapper/121:20:151
162702160,1sleep20-21swapper/200:27:492
2484991510,3cyclictest4564-21ssh21:28:123
2484991510,3cyclictest0-21swapper/320:35:133
248399151,4cyclictest0-21swapper/222:38:042
248399151,2cyclictest29134-21nfs4_client23:00:162
2483991512,2cyclictest596-21kworker/u8:000:12:012
2483991512,2cyclictest4968-21kworker/u8:021:31:042
2483991512,2cyclictest4968-21kworker/u8:021:31:042
2483991512,2cyclictest19727-21kworker/u8:121:12:012
2483991512,2cyclictest10920-21kworker/u8:121:36:042
2483991510,3cyclictest0-21swapper/219:45:182
248399150,13cyclictest0-21swapper/222:26:462
248299151,3cyclictest30362-21iostat_ios23:35:171
248299150,2cyclictest0-21swapper/123:55:171
248299150,13cyclictest2691-21kworker/u8:119:11:041
248299150,13cyclictest18747-21diskmemload00:10:171
248299150,13cyclictest0-21swapper/122:10:101
248299150,13cyclictest0-21swapper/120:06:021
2481991510,3cyclictest13746-21users23:51:040
248199150,13cyclictest0-21swapper/022:34:590
248499149,3cyclictest30062-21diskstats23:35:143
2484991410,2cyclictest0-21swapper/322:11:123
248499140,3cyclictest18212-21ssh23:22:403
248499140,12cyclictest5501-21ssh22:02:193
248499140,12cyclictest0-21swapper/320:06:003
2483991411,2cyclictest8973-21kworker/u8:020:54:042
2483991411,2cyclictest6145-21kworker/u8:100:08:022
2483991411,2cyclictest4652-21kworker/u8:123:15:052
2483991411,2cyclictest27774-21kworker/u8:023:51:042
2483991411,2cyclictest2691-21kworker/u8:119:52:022
2483991411,2cyclictest17891-21ssh21:41:252
2483991411,2cyclictest13056-21kworker/u8:020:03:042
2483991411,2cyclictest13056-21kworker/u8:019:39:042
2483991411,2cyclictest0-21swapper/222:06:152
248399140,3cyclictest3176-21uniq19:10:142
248399140,2cyclictest0-21swapper/223:47:352
248399140,13cyclictest0-21swapper/223:38:052
248399140,13cyclictest0-21swapper/200:19:152
248299149,4cyclictest0-21swapper/123:05:541
248299149,3cyclictest8400-21rm00:20:121
248299142,7cyclictest0-21swapper/123:20:001
248299142,6cyclictest0-21swapper/122:45:001
248299142,6cyclictest0-21swapper/119:45:001
248299142,6cyclictest0-21swapper/119:40:001
2482991411,2cyclictest18747-21diskmemload21:31:081
2482991411,2cyclictest18747-21diskmemload21:31:071
248299140,2cyclictest18747-21diskmemload00:27:171
248299140,13cyclictest0-21swapper/123:20:071
248299140,13cyclictest0-21swapper/100:38:371
248299140,12cyclictest5077-21rm23:42:321
248299140,12cyclictest0-21swapper/121:28:501
248199149,3cyclictest26945-21ssh00:05:160
248199140,2cyclictest18747-21diskmemload21:23:380
248199140,13cyclictest0-21swapper/022:35:180
248199140,13cyclictest0-21swapper/000:25:180
248199140,12cyclictest0-21swapper/023:30:140
89102131,2sleep32479-21cyclictest22:05:453
248499138,3cyclictest7971-21ssh00:19:553
248499138,3cyclictest26763-21ssh21:17:323
248499132,6cyclictest0-21swapper/319:55:003
2484991310,2cyclictest0-21swapper/323:32:183
2484991310,2cyclictest0-21swapper/323:18:103
2484991310,2cyclictest0-21swapper/323:11:593
2484991310,2cyclictest0-21swapper/322:39:213
2484991310,2cyclictest0-21swapper/321:39:333
2484991310,2cyclictest0-21swapper/321:23:493
2484991310,2cyclictest0-21swapper/300:26:083
2484991310,2cyclictest0-21swapper/300:20:023
2484991310,2cyclictest0-21swapper/300:12:393
248499130,2cyclictest0-21swapper/323:58:573
248499130,2cyclictest0-21swapper/322:30:183
248499130,12cyclictest0-21swapper/319:30:103
248499130,12cyclictest0-21swapper/300:30:403
248499130,11cyclictest15395-21copy21:40:013
248499130,11cyclictest0-21swapper/322:42:573
248399132,6cyclictest0-21swapper/221:05:002
2483991310,2cyclictest8973-21kworker/u8:021:09:052
2483991310,2cyclictest8973-21kworker/u8:020:55:042
2483991310,2cyclictest2785-21kworker/u8:322:51:052
2483991310,2cyclictest27045-21kworker/u8:020:21:042
2483991310,2cyclictest2691-21kworker/u8:119:30:042
2483991310,2cyclictest12460-21kworker/u8:222:17:042
2483991310,2cyclictest0-21swapper/223:31:002
248399130,2cyclictest9541-21perl22:40:142
248399130,12cyclictest0-21swapper/223:58:452
248399130,12cyclictest0-21swapper/223:29:252
248399130,12cyclictest0-21swapper/222:46:152
248399130,11cyclictest0-21swapper/222:30:142
248299138,3cyclictest8012-21ps23:45:201
248299138,3cyclictest0-21swapper/120:10:121
248299132,6cyclictest0-21swapper/122:20:011
248299131,4cyclictest6249-21grep19:16:021
2482991310,2cyclictest0-21swapper/123:30:461
2482991310,2cyclictest0-21swapper/123:13:571
2482991310,2cyclictest0-21swapper/122:57:331
2482991310,2cyclictest0-21swapper/122:52:441
2482991310,2cyclictest0-21swapper/122:25:221
2482991310,2cyclictest0-21swapper/122:05:131
2482991310,2cyclictest0-21swapper/122:00:071
2482991310,2cyclictest0-21swapper/121:38:331
2482991310,2cyclictest0-21swapper/121:10:251
2482991310,2cyclictest0-21swapper/120:46:021
248299130,2cyclictest207150irq/24-eth121:43:491
248299130,2cyclictest0-21swapper/122:37:591
248299130,2cyclictest0-21swapper/121:51:251
248299130,2cyclictest0-21swapper/121:45:071
248299130,2cyclictest0-21swapper/120:15:151
248299130,2cyclictest0-21swapper/100:15:571
248299130,12cyclictest18747-21diskmemload23:00:141
248299130,12cyclictest0-21swapper/123:27:071
248299130,12cyclictest0-21swapper/122:33:271
248299130,12cyclictest0-21swapper/121:55:071
248299130,11cyclictest18747-21diskmemload00:33:581
2481991310,2cyclictest18747-21diskmemload23:35:480
2481991310,2cyclictest0-21swapper/022:52:180
2481991310,2cyclictest0-21swapper/022:26:380
2481991310,2cyclictest0-21swapper/022:06:080
2481991310,2cyclictest0-21swapper/021:13:380
2481991310,2cyclictest0-21swapper/020:35:120
2481991310,2cyclictest0-21swapper/019:11:020
248199130,2cyclictest18747-21diskmemload23:58:000
248199130,2cyclictest15270-21ssh22:45:580
248199130,2cyclictest14945-21apt-get21:00:110
248199130,2cyclictest0-21swapper/000:11:040
248199130,12cyclictest0-21swapper/022:02:180
100852130,1sleep00-21swapper/022:40:270
36112120,1sleep00-21swapper/021:26:540
259222120,2sleep33649-21snmpd22:56:563
248499129,2cyclictest0-21swapper/323:25:183
248499129,2cyclictest0-21swapper/323:06:413
248499129,2cyclictest0-21swapper/323:01:593
248499129,2cyclictest0-21swapper/321:55:523
248499129,2cyclictest0-21swapper/321:05:013
248499129,2cyclictest0-21swapper/320:55:213
248499129,2cyclictest0-21swapper/320:50:113
248499129,2cyclictest0-21swapper/300:38:183
248499122,6cyclictest0-21swapper/319:50:003
248499120,2cyclictest0-21swapper/323:50:013
248499120,2cyclictest0-21swapper/323:46:023
248499120,2cyclictest0-21swapper/323:42:043
248499120,2cyclictest0-21swapper/322:26:423
248499120,2cyclictest0-21swapper/321:51:013
248499120,2cyclictest0-21swapper/321:31:213
248499120,2cyclictest0-21swapper/321:31:213
248499120,2cyclictest0-21swapper/319:40:193
248499120,2cyclictest0-21swapper/300:05:443
248499120,11cyclictest0-21swapper/322:50:003
248499120,11cyclictest0-21swapper/322:16:223
248499120,11cyclictest0-21swapper/321:12:113
248499120,11cyclictest0-21swapper/320:15:503
248399129,2cyclictest27589-21kworker/u8:122:00:052
248399129,2cyclictest0-21swapper/200:01:002
248399120,2cyclictest0-21swapper/220:45:052
248399120,11cyclictest0-21swapper/200:23:462
248299129,2cyclictest0-21swapper/100:06:441
248299128,2cyclictest0-21swapper/119:50:141
248299122,6cyclictest0-21swapper/120:41:231
248299121,3cyclictest4835-21munin-node1
248299121,3cyclictest14606-21missed_timers22:45:181
248299121,3cyclictest0-21swapper/121:00:131
248299120,2cyclictest0-21swapper/121:05:321
248299120,2cyclictest0-21swapper/120:00:401
248299120,11cyclictest0-21swapper/123:51:271
248299120,11cyclictest0-21swapper/121:16:321
248299120,11cyclictest0-21swapper/119:55:141
248199129,2cyclictest0-21swapper/023:10:170
248199129,2cyclictest0-21swapper/022:15:200
248199129,2cyclictest0-21swapper/021:46:050
248199129,2cyclictest0-21swapper/021:38:380
248199129,2cyclictest0-21swapper/019:30:120
248199129,2cyclictest0-21swapper/000:31:040
248199127,3cyclictest32719-21turbostat23:05:000
248199127,3cyclictest0-21swapper/023:27:040
248199122,6cyclictest0-21swapper/021:00:010
248199122,6cyclictest0-21swapper/020:55:000
248199121,6cyclictest8707-21copy20:45:000
248199120,2cyclictest0-21swapper/021:57:280
248199120,11cyclictest0-21swapper/023:15:240
248199120,11cyclictest0-21swapper/021:50:170
248199120,11cyclictest0-21swapper/000:39:240
248199120,11cyclictest0-21swapper/000:01:580
248199120,10cyclictest0-21swapper/000:20:110
248199120,10cyclictest0-21swapper/000:17:510
17742120,2sleep21784-21ssh21:59:232
81352110,1sleep30-21swapper/320:41:053
248499116,3cyclictest31935-21tail20:20:173
248499110,1cyclictest0-21swapper/319:55:503
248499110,10cyclictest0-21swapper/322:47:113
248399118,2cyclictest16307-21ssh23:20:192
248399110,2cyclictest0-21swapper/220:27:042
248399110,10cyclictest0-21swapper/221:24:042
248299116,3cyclictest8908-21munin-node1
248299111,8cyclictest0-21swapper/119:40:151
248299110,9cyclictest0-21swapper/120:30:111
248299110,9cyclictest0-21swapper/119:20:151
248199118,2cyclictest0-21swapper/023:05:460
248199118,2cyclictest0-21swapper/022:21:180
248199111,7cyclictest0-21swapper/019:56:140
248199111,6cyclictest0-21swapper/020:11:170
248199111,5cyclictest0-21swapper/023:20:000
248199110,2cyclictest0-21swapper/023:48:050
248199110,2cyclictest0-21swapper/023:43:270
248199110,10cyclictest0-21swapper/022:10:010
248499105,3cyclictest28558-21kworker/u8:219:25:403
248499101,5cyclictest0-21swapper/320:15:003
248399107,2cyclictest0-21swapper/220:15:152
248399105,3cyclictest12608-21cut22:10:122
248399101,5cyclictest0-21swapper/220:41:042
248399101,5cyclictest0-21swapper/220:31:212
248399100,9cyclictest0-21swapper/220:36:032
248399100,2cyclictest0-21swapper/220:05:042
248299101,6cyclictest0-21swapper/120:21:191
248299100,8cyclictest0-21swapper/120:25:101
248199107,2cyclictest0-21swapper/021:31:470
248199107,2cyclictest0-21swapper/021:31:470
248199105,3cyclictest26229-21sshd22:57:240
248199102,6cyclictest0-21swapper/020:34:590
24849996,2cyclictest0-21swapper/321:01:213
24849996,2cyclictest0-21swapper/320:25:103
24849995,3cyclictest3703-21sshd19:37:363
24849994,3cyclictest9833-21proc_pri20:45:193
24849994,3cyclictest7139-21tr19:20:123
24849994,3cyclictest5939-21chrt19:15:503
24839994,3cyclictest5812-21proc_pri19:15:172
24839990,2cyclictest0-21swapper/219:40:042
24829994,3cyclictest13088-21egrep20:55:161
24819994,3cyclictest7177-21df_abs20:40:150
24819994,3cyclictest7034-21aten2.4_r3power19:20:120
24819994,3cyclictest29120-21aten2.4-expect20:15:120
24819994,3cyclictest24124-21mailstats20:01:010
24819994,3cyclictest17557-21hwlatdetect21:05:170
24819991,3cyclictest0-21swapper/019:16:020
24819990,7cyclictest0-21swapper/020:05:030
24849983,3cyclictest26204-21kworker/3:020:30:123
24849983,3cyclictest23080-21aten2.4_r3power20:00:123
24849980,7cyclictest0-21swapper/319:10:003
24839984,2cyclictest27052-21apt-get20:10:112
24819983,3cyclictest3728-21runrttasks19:40:070
24819983,3cyclictest1482-21tr20:25:140
24819983,3cyclictest13238-21df_abs19:35:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional