You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-13 - 10:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Sun Jul 13, 2025 00:44:38)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3259799173163,9cyclictest9025-21smartctl19:15:190
3259799156145,10cyclictest618-21gpgv19:10:020
2181121420,1sleep30-21swapper/322:20:243
3260099125120,2cyclictest0-21swapper/119:15:191
323452117103,10sleep30-21swapper/319:09:343
320432116103,10sleep20-21swapper/219:05:392
32169210794,10sleep10-21swapper/119:07:181
28026210794,9sleep00-21swapper/019:05:210
3260099106102,1cyclictest0-21swapper/119:10:021
32603999593,1cyclictest0-21swapper/219:15:192
32603997875,2cyclictest0-21swapper/219:10:022
32600994820,9cyclictest25707-21kworker/u16:0+events_unbound00:00:121
32597994440,3cyclictest29423-21kworker/u16:3+events_unbound20:40:210
32600994339,3cyclictest29423-21kworker/u16:3+events_unbound22:50:021
241062430,1chrt36-21ksoftirqd/219:25:272
3260099429,6cyclictest0-21swapper/122:45:441
32600994210,5cyclictest0-21swapper/100:16:361
3260099419,5cyclictest0-21swapper/122:32:131
3260099419,5cyclictest0-21swapper/100:24:291
3260099415,9cyclictest0-21swapper/120:59:491
3260099409,6cyclictest0-21swapper/121:22:131
3260099408,5cyclictest0-21swapper/120:23:281
3260099407,6cyclictest0-21swapper/121:56:411
3260099407,6cyclictest0-21swapper/119:43:521
3260099405,8cyclictest0-21swapper/121:01:041
3260099405,8cyclictest0-21swapper/119:48:161
3260099399,6cyclictest0-21swapper/121:35:121
3260099399,6cyclictest0-21swapper/121:17:121
3260099399,3cyclictest0-21swapper/119:55:481
3260099396,6cyclictest0-21swapper/121:32:011
3260099396,6cyclictest0-21swapper/119:35:121
3260099385,6cyclictest0-21swapper/120:18:041
3260099385,6cyclictest0-21swapper/120:10:531
32597993834,3cyclictest29423-21kworker/u16:3+events_unbound19:30:010
32597993832,4cyclictest29423-21kworker/u16:3+events_unbound23:00:240
3260099379,3cyclictest0-21swapper/100:25:571
3260099377,6cyclictest0-21swapper/120:01:041
3260099374,6cyclictest0-21swapper/120:30:481
3259799373,8cyclictest20648-21kthreadcore22:20:230
3260099366,3cyclictest0-21swapper/122:37:371
32597993632,3cyclictest29423-21kworker/u16:3+events_unbound21:50:010
3260099355,6cyclictest0-21swapper/121:06:481
3260099355,6cyclictest0-21swapper/119:53:321
3260099352,6cyclictest0-21swapper/100:39:431
32597993531,3cyclictest29423-21kworker/u16:3+events_unbound20:00:050
32597993531,3cyclictest25707-21kworker/u16:0+events_unbound19:45:020
32597993529,4cyclictest29423-21kworker/u16:3+events_unbound23:50:270
3259799352,8cyclictest0-21swapper/021:55:180
3259799351,6cyclictest0-21swapper/022:51:540
32600993429,4cyclictest25707-21kworker/u16:0+events_unbound23:40:271
32600993428,4cyclictest25707-21kworker/u16:0+events_unbound00:30:171
3260099341,6cyclictest0-21swapper/123:58:121
3260099340,7cyclictest0-21swapper/119:26:291
3259799344,5cyclictest0-21swapper/022:58:000
3259799344,5cyclictest0-21swapper/022:58:000
3259799344,5cyclictest0-21swapper/022:06:500
3259799344,5cyclictest0-21swapper/021:48:100
3259799344,5cyclictest0-21swapper/021:20:000
32597993430,3cyclictest29423-21kworker/u16:3+events_unbound23:20:180
3260099332,8cyclictest0-21swapper/123:34:161
3260099332,6cyclictest29304-21cut22:00:191
3260099330,6cyclictest0-21swapper/122:29:591
3260099330,6cyclictest0-21swapper/121:13:571
3259799333,5cyclictest0-21swapper/020:05:140
3259799333,5cyclictest0-21swapper/019:53:510
32597993329,3cyclictest29423-21kworker/u16:3+events_unbound20:15:230
32597993329,3cyclictest29423-21kworker/u16:3+events_unbound00:10:270
32597993329,3cyclictest25707-21kworker/u16:0+events_unbound23:30:200
32600993228,3cyclictest29423-21kworker/u16:3+events_unbound22:10:261
3260099322,6cyclictest0-21swapper/100:09:381
3260099321,6cyclictest0-21swapper/120:25:181
32597993228,3cyclictest25707-21kworker/u16:0+events_unbound00:25:250
32597993227,4cyclictest25707-21kworker/u16:0+events_unbound22:30:180
3259799322,5cyclictest0-21swapper/023:13:340
3259799322,5cyclictest0-21swapper/023:09:130
3259799322,5cyclictest0-21swapper/022:13:420
3259799322,5cyclictest0-21swapper/020:13:440
3259799321,8cyclictest0-21swapper/021:00:000
32600993127,3cyclictest29423-21kworker/u16:3+events_unbound21:40:011
3260099311,6cyclictest0-21swapper/123:45:591
3259799314,5cyclictest0-21swapper/022:01:320
3259799314,5cyclictest0-21swapper/019:55:360
3259799314,5cyclictest0-21swapper/019:26:450
3259799310,6cyclictest0-21swapper/000:02:270
3260099300,6cyclictest0-21swapper/123:10:581
3259799304,5cyclictest31500-40mandb00:00:000
3259799303,5cyclictest0-21swapper/023:26:550
3259799303,5cyclictest0-21swapper/000:37:370
3259799302,6cyclictest0-21swapper/023:18:250
3259799300,6cyclictest0-21swapper/021:14:060
3260099291,6cyclictest10704-21turbostat20:45:011
3260099291,5cyclictest0-21swapper/121:45:171
3259799294,6cyclictest0-21swapper/021:01:510
3259799292,5cyclictest0-21swapper/023:35:010
3259799292,5cyclictest0-21swapper/020:21:190
32597992925,3cyclictest29423-21kworker/u16:3+events_unbound20:35:260
32597992925,3cyclictest29423-21kworker/u16:3+events_unbound20:30:170
32597992925,3cyclictest25707-21kworker/u16:0+events_unbound22:45:260
32597992923,4cyclictest29423-21kworker/u16:3+events_unbound00:05:300
32600992824,3cyclictest29423-21kworker/u16:3+events_unbound22:20:011
32600992824,3cyclictest25707-21kworker/u16:0+events_unbound22:55:011
32600992824,3cyclictest25707-21kworker/u16:0+events_unbound22:55:011
3260099281,6cyclictest0-21swapper/122:41:241
3260099281,6cyclictest0-21swapper/120:46:541
3260099280,8cyclictest0-21swapper/100:11:501
3260099280,6cyclictest0-21swapper/123:09:551
3259799284,5cyclictest0-21swapper/021:35:490
3259799284,5cyclictest0-21swapper/021:30:340
32597992825,2cyclictest29423-21kworker/u16:3+events_unbound23:40:180
32603992722,3cyclictest25707-21kworker/u16:0+events_unbound23:15:012
3260099272,6cyclictest0-21swapper/123:23:281
3260099272,6cyclictest0-21swapper/123:02:101
3260099272,6cyclictest0-21swapper/121:53:071
3260099272,5cyclictest0-21swapper/120:35:181
3259799270,5cyclictest0-21swapper/020:25:010
3260099261,6cyclictest0-21swapper/119:30:311
3259799264,5cyclictest0-21swapper/022:42:060
3259799264,5cyclictest0-21swapper/021:07:290
3259799264,5cyclictest0-21swapper/019:24:480
3259799261,6cyclictest0-21swapper/022:15:410
32603992522,2cyclictest25707-21kworker/u16:0+events_unbound21:40:202
32603992521,3cyclictest29423-21kworker/u16:3+events_unbound19:34:592
32603992521,3cyclictest25707-21kworker/u16:0+events_unbound19:45:262
32600992521,3cyclictest29423-21kworker/u16:3+events_unbound23:15:251
3259799254,5cyclictest0-21swapper/022:29:530
3259799254,5cyclictest0-21swapper/000:16:560
3259799253,5cyclictest0-21swapper/023:48:110
3259799253,5cyclictest0-21swapper/020:50:190
3260099242,6cyclictest0-21swapper/123:51:021
3260099240,6cyclictest0-21swapper/119:23:091
3259799243,5cyclictest0-21swapper/022:36:480
3260099234,5cyclictest0-21swapper/123:37:101
3259799234,5cyclictest0-21swapper/021:26:490
32597992320,2cyclictest25707-21kworker/u16:0+events_unbound00:20:000
32597992319,3cyclictest25707-21kworker/u16:0+events_unbound00:30:150
32603992218,3cyclictest29423-21kworker/u16:3+events_unbound20:30:252
32603992217,3cyclictest29423-21kworker/u16:3+events_unbound20:50:012
3260099220,8cyclictest0-21swapper/120:09:081
32603992115,4cyclictest9922-21basename23:40:152
3260099212,6cyclictest241irq_work/123:25:261
3259799213,5cyclictest0-21swapper/019:37:400
3259799212,6cyclictest0-21swapper/021:22:510
3259799201,6cyclictest0-21swapper/021:41:210
32603991915,3cyclictest25707-21kworker/u16:0+events_unbound22:40:012
3260099192,7cyclictest18502-21kworker/1:0+events21:25:151
3260099180,7cyclictest261rcuc/120:50:191
32597991814,3cyclictest29423-21kworker/u16:3+events_unbound19:40:250
32603991713,3cyclictest25707-21kworker/u16:0+events_unbound21:00:282
32603991612,3cyclictest25707-21kworker/u16:0+events_unbound23:05:282
3260099166,6cyclictest0-21swapper/122:15:441
3260099163,6cyclictest3728-21cut22:05:221
32603991512,2cyclictest0-21swapper/223:59:592
32603991511,3cyclictest29423-21kworker/u16:3+events_unbound23:00:272
32603991511,3cyclictest29423-21kworker/u16:3+events_unbound20:40:182
32603991511,3cyclictest29423-21kworker/u16:3+events_unbound20:25:262
32603991511,3cyclictest29423-21kworker/u16:3+events_unbound20:10:272
3259799154,6cyclictest0-21swapper/020:45:190
32603991410,3cyclictest29423-21kworker/u16:3+events_unbound20:00:282
32603991410,3cyclictest25707-21kworker/u16:0+events_unbound22:05:002
32603991410,3cyclictest25707-21kworker/u16:0+events_unbound20:20:172
32603991410,3cyclictest25707-21kworker/u16:0+events_unbound00:00:242
32603991310,2cyclictest25707-21kworker/u16:0+events_unbound00:10:002
3260399129,2cyclictest24327-21tail00:20:252
3260399127,4cyclictest25707-21kworker/u16:0+events_unbound21:20:182
3260399126,4cyclictest18514-21cut19:50:222
3260399123,4cyclictest716-21snmpd21:10:202
3260399116,4cyclictest8217-21sed22:10:182
3260399116,4cyclictest716-21snmpd20:17:042
3260399112,8cyclictest23867-21cut20:55:212
3260399110,9cyclictest4724-21cut22:35:242
3260399110,9cyclictest12999-21cut21:15:192
3260399110,2cyclictest94982missed_timers00:05:262
3260399110,11cyclictest0-21swapper/221:05:212
3260399109,1cyclictest0-21swapper/223:10:132
3260399108,1cyclictest0-21swapper/221:25:242
3260399104,4cyclictest5981-21cut23:35:232
3260399104,4cyclictest27321-21cut00:25:132
3260399103,6cyclictest161402sleep220:49:162
3260399103,5cyclictest22350-21cut19:55:232
3260399102,3cyclictest28549-21tr21:30:132
3260399102,3cyclictest25946-21cut22:25:272
3260399100,8cyclictest9637-21cut00:35:222
3260399100,8cyclictest31847-21kthreadcore19:35:212
3260399100,8cyclictest31341-21cut23:30:172
3260399100,8cyclictest29630-21irqcore22:00:222
3260399100,8cyclictest26064-21kthreadcore22:55:242
3260399100,8cyclictest26064-21kthreadcore22:55:232
3260399100,8cyclictest24237-21irqrtprio21:55:202
3260399100,8cyclictest20280-21cut00:15:232
3260399100,8cyclictest19073-21apt19:25:002
3260399100,8cyclictest18164-21aten2_r5power_c22:20:152
3260399100,8cyclictest15354-21cut22:15:232
3260399100,8cyclictest15098-21kthreadcore21:45:202
3260399100,8cyclictest1508-21cut20:05:222
3260399100,5cyclictest14671-21kthreadcore22:45:192
3260399100,1cyclictest29076-21apt-get22:30:162
3260399100,10cyclictest0-21swapper/223:25:272
326039996,2cyclictest0-21swapper/221:50:182
326039994,4cyclictest20820-21aten2_r5power_c23:50:142
326039990,8cyclictest32641-21grep20:35:172
326039990,4cyclictest5086-21kthreadcore19:40:222
326039990,4cyclictest3316-21cut00:30:232
326039990,4cyclictest2367-21cut21:35:192
326039990,4cyclictest21835-21kthreadcore23:20:192
326039990,4cyclictest19994-21tune2fs22:50:212
326039990,4cyclictest16644-21cut23:45:232
19249280,5sleep30-21swapper/322:50:023
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
5092270,5sleep30-21swapper/300:05:013
3798270,5sleep30-21swapper/319:40:153
23613270,5sleep30-21swapper/322:25:183
16623270,5sleep30-21swapper/320:50:013
14772270,6sleep30-21swapper/319:50:023
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
869260,5sleep30-21swapper/321:32:183
8016260,4sleep30-21swapper/322:40:123
4370260,4sleep30-21swapper/323:35:163
32739260,4sleep30-21swapper/300:30:143
31268260,2sleep30-21swapper/323:57:313
30665260,4sleep30-21swapper/319:35:143
28302260,2sleep30-21swapper/321:58:363
26730260,2sleep30-21swapper/300:21:173
25065260,4sleep30-21swapper/319:30:013
24878260,4sleep30-21swapper/322:55:163
24878260,4sleep30-21swapper/322:55:163
24209263,2sleep30-21swapper/319:25:563
22835260,4sleep30-21swapper/321:25:133
2118260,4sleep30-21swapper/322:35:153
20316260,4sleep30-21swapper/323:20:123
20015260,2sleep30-21swapper/323:19:443
1378260,6sleep30-21swapper/322:03:443
12659260,4sleep30-21swapper/322:15:153
10114260,4sleep30-21swapper/320:15:143
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
6056250,4sleep30-21swapper/321:08:453
31768250,3sleep30-21swapper/300:00:123
31224250,2sleep30-21swapper/320:03:253
20254250,3sleep30-21swapper/319:55:153
18778250,2sleep30-21swapper/319:21:203
14023251,2sleep30-21swapper/323:40:253
12286250,2sleep30-21swapper/322:13:343
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
8729240,2sleep30-21swapper/319:15:193
6406240,3sleep30-21swapper/321:10:023
531240,4sleep30-21swapper/321:03:123
4787240,2sleep30-21swapper/320:39:563
31347240,2sleep30-21swapper/320:05:003
27621240,2sleep30-21swapper/320:59:553
27185240,2sleep30-21swapper/320:30:183
25543240,2sleep30-21swapper/323:25:023
22252240,3sleep30-21swapper/321:20:533
20814240,2sleep30-21swapper/300:15:283
20802240,2sleep30-21swapper/320:25:003
18571240,2sleep30-21swapper/321:50:233
17913240,2sleep30-21swapper/322:45:253
17041240,2sleep30-21swapper/321:19:243
1689240,3sleep30-21swapper/322:32:553
15931241,2sleep30-21swapper/300:13:163
15073240,2sleep30-21swapper/323:45:023
13137240,2sleep30-21swapper/323:10:223
10688240,2sleep30-21swapper/320:45:003
9044230,1sleep30-21swapper/319:45:003
6812230,2sleep30-21swapper/321:40:043
5762230,2sleep30-21swapper/300:35:033
5469230,2sleep30-21swapper/320:40:123
519230,2sleep30-21swapper/319:10:023
4634230,2sleep30-21swapper/320:10:013
3258230,2sleep30-21swapper/323:05:013
31275230,2sleep30-21swapper/323:30:033
30392230,2sleep30-21swapper/323:00:053
27266230,2sleep30-21swapper/300:25:013
20784230,2sleep30-21swapper/323:50:023
1630230,2sleep30-21swapper/322:05:013
15584230,2sleep30-21swapper/320:20:033
1329230,2sleep30-21swapper/321:35:033
12226230,2sleep30-21swapper/321:45:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional