You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-11-17 - 14:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Tue Nov 17, 2026 12:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2964321080,2sleep30-21swapper/309:45:383
2964321080,2sleep30-21swapper/309:45:383
104052970,1chrt10404-21load08:55:311
104052970,1chrt10404-21load08:55:311
218562880,2sleep30-21swapper/309:25:363
218562880,2sleep30-21swapper/309:25:363
218562880,2sleep30-21swapper/309:25:363
159842840,3sleep30-21swapper/312:05:163
159842840,3sleep30-21swapper/312:05:163
266762820,3sleep20-21swapper/212:30:392
266762820,3sleep20-21swapper/212:30:392
258012810,2sleep00-21swapper/008:10:320
258012810,2sleep00-21swapper/008:10:320
234082780,3sleep30-21swapper/310:55:373
193802710,3sleep30-21swapper/312:10:423
193802710,3sleep30-21swapper/312:10:423
289852700,3chrt0-21swapper/308:20:193
130122690,3sleep30-21swapper/307:35:333
204102660,3sleep20-21swapper/212:15:312
204102660,3sleep20-21swapper/212:15:312
283972650,3sleep20-21swapper/211:10:312
56922580,2sleep10-21swapper/111:35:341
56922580,2sleep10-21swapper/111:35:341
56922580,2sleep10-21swapper/111:35:341
222682560,1sleep20-21swapper/209:25:392
222682560,1sleep20-21swapper/209:25:392
222682560,1sleep20-21swapper/209:25:392
196512560,3sleep00-21swapper/010:45:370
196512560,3sleep00-21swapper/010:45:370
196512560,3sleep00-21swapper/010:45:370
217422510,2chrt0-21swapper/009:25:330
217422510,2chrt0-21swapper/009:25:330
217422510,2chrt0-21swapper/009:25:330
311722500,3sleep20-21swapper/209:50:352
311722500,3sleep20-21swapper/209:50:352
186902470,3sleep20-21swapper/212:10:332
186902470,3sleep20-21swapper/212:10:332
109572470,5sleep010960-21sed11:50:290
109572470,5sleep010960-21sed11:50:290
240982460,2sleep2351rcuc/208:05:312
240982460,2sleep2351rcuc/208:05:312
160192460,2sleep015990-21latency_hist12:05:160
160192460,2sleep015990-21latency_hist12:05:160
142342450,3chrt0-21swapper/207:40:272
142342450,3chrt0-21swapper/207:40:272
301402440,4sleep20-21swapper/208:20:392
301402440,4sleep20-21swapper/208:20:392
8502430,2sleep0854-21if_eth008:30:290
8502430,2sleep0854-21if_eth008:30:290
87942420,3sleep20-21swapper/208:50:372
84022420,2sleep08403-21/usr/sbin/munin08:50:310
122822420,3sleep20-21swapper/211:55:172
122822420,3sleep20-21swapper/211:55:172
316422410,1sleep131649-21gzip08:25:331
316422410,1sleep131649-21gzip08:25:331
18642400,3sleep20-21swapper/210:00:282
18642400,3sleep20-21swapper/210:00:282
113222380,3sleep20-21swapper/210:25:292
113222380,3sleep20-21swapper/210:25:292
86902370,2sleep18793-21grep08:50:371
232812370,3sleep20-21swapper/210:55:362
5059993630,4cyclictest27656-21if_err_wlan008:15:311
5059993629,5cyclictest550-21cron10:05:171
5059993629,5cyclictest550-21cron10:05:171
5059993629,5cyclictest22330-21netstat08:00:351
5059993629,5cyclictest22330-21netstat08:00:351
5059993628,6cyclictest1-21systemd12:00:341
5059993628,6cyclictest1-21systemd12:00:341
219052360,2sleep30-21swapper/312:20:273
219052360,2sleep30-21swapper/312:20:273
164972360,2sleep116687-21sed09:10:391
164972360,2sleep116687-21sed09:10:391
5059993527,5cyclictest30950-21sendmail12:45:161
5059993527,5cyclictest30950-21sendmail12:45:161
300272350,2sleep130028-21fschecks_time11:15:281
5059993425,7cyclictest26077-21netstat08:10:361
5059993425,7cyclictest26077-21netstat08:10:361
5059993328,3cyclictest0-21swapper/112:30:161
5059993328,3cyclictest0-21swapper/112:30:161
5059993328,3cyclictest0-21swapper/112:30:161
5059993324,7cyclictest9470-21fschecks_time10:20:281
5059993324,7cyclictest9470-21fschecks_time10:20:281
5059993324,7cyclictest9470-21fschecks_time10:20:281
62182320,2sleep06220-21ntp_kernel_pll_10:10:350
62182320,2sleep06220-21ntp_kernel_pll_10:10:350
5057993227,3cyclictest90-1pr/ttyS007:40:530
5057993227,3cyclictest90-1pr/ttyS007:40:530
5057993225,5cyclictest28550-21/usr/sbin/munin09:45:340
5057993225,5cyclictest28550-21/usr/sbin/munin09:45:340
5057993223,7cyclictest27743-21sh11:10:180
5057993223,7cyclictest27743-21sh11:10:180
5057993223,7cyclictest27743-21sh11:10:180
5057993223,7cyclictest14040-21threads10:30:380
5057993223,7cyclictest14040-21threads10:30:380
273342320,4sleep20-21swapper/208:15:282
216072320,2sleep121764-21users10:50:411
216072320,2sleep121764-21users10:50:411
5079993119,8cyclictest7041-21chrt10:14:083
5079993119,8cyclictest7041-21chrt10:14:083
5059993124,5cyclictest6413-21gltestperf08:45:311
5059993124,5cyclictest6413-21gltestperf08:45:311
5057993127,2cyclictest0-21swapper/008:45:290
5057993127,2cyclictest0-21swapper/008:45:290
5057993124,5cyclictest1493-21latency_hist10:00:160
5057993123,6cyclictest29172-21unixbench_multi11:10:400
5057993123,6cyclictest13569-21timerwakeupswit11:55:380
5057993123,6cyclictest13569-21timerwakeupswit11:55:380
5079993019,7cyclictest24542-21chrt09:34:483
5079993019,7cyclictest24542-21chrt09:34:483
5079993019,7cyclictest24542-21chrt09:34:483
5079993018,8cyclictest25780-21chrt11:04:213
5079993018,8cyclictest25780-21chrt11:04:213
5079993018,8cyclictest17841-21chrt12:09:543
5079993018,8cyclictest17841-21chrt12:09:543
5079993018,8cyclictest10134-21chrt11:47:103
5079993018,8cyclictest10134-21chrt11:47:103
5079993018,7cyclictest2775-21chrt11:29:253
5079993018,7cyclictest2775-21chrt11:29:253
5059993021,6cyclictest16671-21latency_hist10:40:221
5059993020,7cyclictest5984-21latency_hist08:45:211
5059993020,7cyclictest5984-21latency_hist08:45:211
5057993025,3cyclictest0-21swapper/012:35:390
5057993025,3cyclictest0-21swapper/012:35:390
12452300,3sleep20-21swapper/208:30:362
12452300,3sleep20-21swapper/208:30:362
5079992924,3cyclictest0-21swapper/308:36:113
5079992924,3cyclictest0-21swapper/308:36:113
5079992919,7cyclictest18295-21chrt10:44:073
5079992919,7cyclictest18295-21chrt10:44:073
5079992919,7cyclictest18295-21chrt10:44:073
5079992919,7cyclictest15438-21chrt07:40:443
5079992919,7cyclictest15438-21chrt07:40:443
5079992918,8cyclictest5497-21chrt08:41:063
5079992918,8cyclictest5497-21chrt08:41:063
5079992918,8cyclictest26092-21chrt09:35:453
5079992918,8cyclictest26092-21chrt09:35:453
5079992918,8cyclictest26092-21chrt09:35:453
5079992918,8cyclictest19264-21chrt07:51:453
5079992918,8cyclictest19264-21chrt07:51:453
5079992918,8cyclictest10537-21chrt10:20:473
5079992918,8cyclictest10537-21chrt10:20:473
5079992918,8cyclictest10537-21chrt10:20:473
5079992917,9cyclictest11676-21chrt09:00:233
5079992917,8cyclictest27412-21chrt11:06:023
5079992917,8cyclictest27412-21chrt11:06:023
5079992917,8cyclictest27412-21chrt11:06:023
5059992924,4cyclictest32462-21fschecks_count09:55:291
5059992921,6cyclictest16210-21fschecks_count07:45:281
5059992921,6cyclictest16210-21fschecks_count07:45:281
5057992925,3cyclictest25061-21gltestperf09:35:300
5057992925,3cyclictest25061-21gltestperf09:35:300
5057992925,3cyclictest25061-21gltestperf09:35:300
5057992924,3cyclictest90-1pr/ttyS009:10:250
5057992923,4cyclictest5056-21cyclictest11:49:000
5057992923,4cyclictest5056-21cyclictest11:49:000
5057992923,4cyclictest26443-21latency_hist09:40:300
5057992923,4cyclictest26443-21latency_hist09:40:300
5057992923,4cyclictest26443-21latency_hist09:40:300
5057992921,6cyclictest21280-21sshd10:50:380
5057992921,6cyclictest21280-21sshd10:50:380
5057992921,3cyclictest181rcu_preempt09:52:570
5057992921,3cyclictest181rcu_preempt09:52:570
5079992819,5cyclictest12477-21chrt10:26:263
5079992819,5cyclictest12477-21chrt10:26:263
5079992818,7cyclictest24862-21chrt08:06:373
5079992818,7cyclictest24862-21chrt08:06:373
5079992818,7cyclictest20561-21chrt09:21:503
5079992818,7cyclictest20561-21chrt09:21:503
5079992818,7cyclictest15110-21chrt09:08:433
5079992818,7cyclictest15110-21chrt09:08:433
5079992818,6cyclictest8649-21chrt10:15:493
5079992818,6cyclictest743-21chrt11:23:183
5079992818,6cyclictest743-21chrt11:23:183
5079992818,6cyclictest23228-21chrt08:04:523
5079992818,6cyclictest23228-21chrt08:04:523
5079992818,6cyclictest20198-21chrt10:49:213
5079992818,6cyclictest20198-21chrt10:49:213
5079992818,6cyclictest20198-21chrt10:49:213
5079992817,8cyclictest21244-21chrt07:58:163
5079992817,8cyclictest18823-21chrt09:18:283
5079992817,8cyclictest18823-21chrt09:18:283
5079992817,8cyclictest17347-21chrt07:46:023
5079992817,8cyclictest17347-21chrt07:46:023
5079992817,7cyclictest8321-21chrt11:43:283
5079992817,7cyclictest8321-21chrt11:43:283
5079992817,7cyclictest8321-21chrt11:43:283
5079992817,7cyclictest29031-21chrt12:39:443
5079992817,7cyclictest29031-21chrt12:39:443
5079992817,7cyclictest22042-21chrt10:54:083
5079992817,7cyclictest22042-21chrt10:54:083
5079992817,7cyclictest12178-21chrt11:54:343
5079992817,7cyclictest12178-21chrt11:54:343
5079992816,8cyclictest30782-21taskset12:43:183
5079992816,8cyclictest30782-21taskset12:43:183
5059992823,3cyclictest0-21swapper/111:55:281
5059992823,3cyclictest0-21swapper/111:55:281
5059992821,5cyclictest550-21cron09:05:161
5057992822,4cyclictest30547-21head12:40:400
5057992822,4cyclictest30547-21head12:40:400
5057992821,5cyclictest25088-21sshd08:09:350
5057992821,5cyclictest25088-21sshd08:09:350
5057992820,6cyclictest13381-21latency_hist09:05:170
5057992819,7cyclictest12151-21threads10:25:380
5057992819,7cyclictest12151-21threads10:25:380
5079992718,6cyclictest29311-21chrt11:11:333
5079992718,6cyclictest27168-21chrt12:34:423
5079992718,6cyclictest27168-21chrt12:34:423
5079992717,7cyclictest16824-21chrt09:11:493
5079992717,7cyclictest16824-21chrt09:11:493
5079992717,6cyclictest4643-21chrt11:34:283
5079992717,6cyclictest4643-21chrt11:34:283
5079992717,6cyclictest31360-21chrt11:18:563
5079992717,6cyclictest26954-21chrt08:14:373
5079992717,6cyclictest26954-21chrt08:14:373
5079992717,6cyclictest1947-21chrt08:33:503
5079992717,6cyclictest1947-21chrt08:33:503
5079992717,6cyclictest14527-21chrt10:33:343
5079992717,6cyclictest14527-21chrt10:33:343
5079992717,5cyclictest111662sleep308:56:333
5079992717,5cyclictest111662sleep308:56:333
5079992716,7cyclictest16339-21chrt10:37:523
5079992716,6cyclictest30423-21chrt08:21:203
5079992716,6cyclictest30423-21chrt08:21:203
5059992721,4cyclictest23019-21unixbench_multi12:20:381
5059992721,4cyclictest23019-21unixbench_multi12:20:381
5059992720,5cyclictest749-21runrttasks11:45:251
5059992720,5cyclictest749-21runrttasks11:45:251
5059992720,5cyclictest749-21runrttasks11:45:251
5059992720,5cyclictest32496-21wc11:20:351
5059992720,5cyclictest32496-21wc11:20:351
5059992718,7cyclictest1335-21fschecks_count11:25:291
5059992718,7cyclictest1335-21fschecks_count11:25:291
5059992717,8cyclictest17672-21gltestperf09:15:291
5059992717,8cyclictest17672-21gltestperf09:15:291
5057992721,5cyclictest24204-21kernelversion12:25:310
5057992721,5cyclictest24204-21kernelversion12:25:310
5057992721,5cyclictest24204-21kernelversion12:25:310
5057992721,4cyclictest1-21systemd09:45:170
5057992721,4cyclictest1-21systemd09:45:170
5057992720,6cyclictest21878-21fschecks_time08:00:290
5057992720,6cyclictest21878-21fschecks_time08:00:290
5057992719,6cyclictest7732-21cut11:40:390
5057992719,6cyclictest7732-21cut11:40:390
5057992719,6cyclictest7732-21cut11:40:390
5057992717,8cyclictest0-21swapper/007:36:520
53672260,3sleep20-21swapper/210:10:212
53672260,3sleep20-21swapper/210:10:212
5079992617,6cyclictest5071-21chrt10:08:053
5079992617,6cyclictest5071-21chrt10:08:053
5079992617,6cyclictest32402-21chrt08:27:273
5079992617,6cyclictest32402-21chrt08:27:273
5079992617,6cyclictest28053-21chrt09:42:043
5079992617,6cyclictest28053-21chrt09:42:043
5079992617,6cyclictest1205-21chrt09:56:433
5079992616,6cyclictest25214-21chrt12:28:313
5079992616,6cyclictest25214-21chrt12:28:313
5079992616,6cyclictest25214-21chrt12:28:313
5059992616,7cyclictest27893-21latency_hist11:10:231
5059992616,7cyclictest27893-21latency_hist11:10:231
5059992616,7cyclictest27893-21latency_hist11:10:231
505799265,2cyclictest181rcu_preempt12:35:200
505799265,2cyclictest181rcu_preempt12:35:200
5057992622,3cyclictest5056-21cyclictest08:20:280
5057992622,3cyclictest5056-21cyclictest08:20:280
5057992621,3cyclictest0-21swapper/010:05:420
5057992621,3cyclictest0-21swapper/010:05:420
5057992620,3cyclictest0-21swapper/009:05:360
5057992619,6cyclictest10932-21timerwakeupswit08:55:380
5057992619,6cyclictest10932-21timerwakeupswit08:55:380
5057992619,5cyclictest32406-21ntp_kernel_pll_11:20:330
5057992619,5cyclictest32406-21ntp_kernel_pll_11:20:330
5057992618,6cyclictest2531-21tune2fs08:35:300
5057992618,6cyclictest2531-21tune2fs08:35:300
5057992616,3cyclictest181rcu_preempt11:17:350
5057992613,7cyclictest90-1pr/ttyS012:05:280
5057992613,7cyclictest90-1pr/ttyS012:05:280
5057992613,11cyclictest0-21swapper/012:20:280
5057992613,11cyclictest0-21swapper/012:20:280
5079992518,4cyclictest7518-21chrt08:47:533
5079992518,4cyclictest7518-21chrt08:47:533
5079992516,6cyclictest31772-21chrt09:51:413
5079992516,6cyclictest31772-21chrt09:51:413
5079992516,6cyclictest21344-21chrt12:17:013
5079992516,6cyclictest21344-21chrt12:17:013
5079992515,6cyclictest30322sleep310:01:103
5079992515,6cyclictest30322sleep310:01:103
5079992515,6cyclictest14147-21chrt12:00:173
5079992515,6cyclictest14147-21chrt12:00:173
5059992521,3cyclictest5056-21cyclictest09:54:261
5059992521,3cyclictest5056-21cyclictest09:54:261
5059992520,3cyclictest25946-21gltestperf12:30:301
5059992520,3cyclictest25946-21gltestperf12:30:301
5059992520,2cyclictest0-21swapper/109:35:171
5059992520,2cyclictest0-21swapper/109:35:171
5059992520,2cyclictest0-21swapper/109:35:171
5059992518,5cyclictest17663-21sshd12:07:341
5059992518,5cyclictest17663-21sshd12:07:341
5059992517,6cyclictest9411-21needreboot11:45:331
5059992517,6cyclictest9411-21needreboot11:45:331
5059992517,6cyclictest21189-21sshd07:57:341
5059992516,7cyclictest2782-21kernelversion08:35:331
5059992516,7cyclictest2782-21kernelversion08:35:331
5059992515,7cyclictest7285-21latency_hist10:15:241
5059992515,7cyclictest7285-21latency_hist10:15:241
5057992521,3cyclictest90-1pr/ttyS011:39:000
5057992521,3cyclictest90-1pr/ttyS011:39:000
5057992521,3cyclictest90-1pr/ttyS011:39:000
5057992519,3cyclictest0-21swapper/010:40:300
5057992519,3cyclictest0-21swapper/010:40:300
5057992519,3cyclictest0-21swapper/010:40:300
5057992518,5cyclictest31712-21sshd08:25:340
5057992518,5cyclictest31712-21sshd08:25:340
5057992518,5cyclictest10910-21idleruntime-cro10:25:170
5057992518,5cyclictest10910-21idleruntime-cro10:25:170
5057992518,5cyclictest10910-21idleruntime-cro10:25:170
5057992518,4cyclictest15634-21ntp_offset10:35:360
5057992517,2cyclictest181rcu_preempt07:55:230
5057992514,9cyclictest18964-21cron09:20:160
5057992514,9cyclictest18964-21cron09:20:160
5079992415,5cyclictest63702sleep311:37:173
5079992415,5cyclictest63702sleep311:37:173
5079992415,5cyclictest63702sleep311:37:173
5059992420,3cyclictest24725-21unixbench_singl08:05:381
5059992420,3cyclictest24725-21unixbench_singl08:05:381
5059992420,2cyclictest0-21swapper/112:35:371
5059992420,2cyclictest0-21swapper/112:35:371
5059992419,3cyclictest0-21swapper/111:30:391
5059992419,3cyclictest0-21swapper/111:30:391
5059992419,3cyclictest0-21swapper/108:20:301
5059992419,3cyclictest0-21swapper/108:20:301
5059992418,4cyclictest21256-21fschecks_count09:25:291
5059992418,4cyclictest21256-21fschecks_count09:25:291
5059992418,4cyclictest21256-21fschecks_count09:25:291
5059992417,5cyclictest28455-21kernelversion11:10:321
5059992417,5cyclictest13738-21ntp_kernel_err10:30:341
5059992417,5cyclictest13738-21ntp_kernel_err10:30:341
5059992417,4cyclictest0-21swapper/107:40:371
5059992417,4cyclictest0-21swapper/107:40:371
5059992415,7cyclictest24491-21fschecks_time11:00:301
5059992415,7cyclictest24491-21fschecks_time11:00:301
505799249,7cyclictest90-1pr/ttyS012:13:100
505799249,7cyclictest90-1pr/ttyS012:13:100
5057992420,2cyclictest0-21swapper/008:20:160
5057992418,4cyclictest601-21snmpd10:16:190
46832240,3sleep20-21swapper/208:40:322
46832240,3sleep20-21swapper/208:40:322
208352240,3sleep00-21swapper/012:15:370
208352240,3sleep00-21swapper/012:15:370
5079992317,3cyclictest9260-21chrt08:50:593
5059992319,3cyclictest5056-21cyclictest07:50:341
5059992319,3cyclictest5056-21cyclictest07:50:341
5059992316,5cyclictest912-21kernelversion08:30:301
5059992316,5cyclictest912-21kernelversion08:30:301
5059992315,6cyclictest19569-21sort09:20:311
5059992315,6cyclictest19569-21sort09:20:311
5059992315,6cyclictest14551-21sort09:05:361
5059992315,6cyclictest14551-21sort09:05:361
5057992319,2cyclictest0-21swapper/007:50:350
5057992319,2cyclictest0-21swapper/007:50:350
5057992318,3cyclictest2437-21unixbench_singl11:25:390
5057992318,3cyclictest2437-21unixbench_singl11:25:390
5057992316,5cyclictest3561-21kernelversion11:30:310
5057992316,5cyclictest3561-21kernelversion11:30:310
5057992316,4cyclictest0-21swapper/007:45:360
5057992316,4cyclictest0-21swapper/007:45:360
5057992315,6cyclictest24595-21sort11:00:310
5057992315,6cyclictest24595-21sort11:00:310
5057992315,6cyclictest2418-21netstat10:00:340
5057992315,6cyclictest2418-21netstat10:00:340
5057992311,7cyclictest90-1pr/ttyS010:58:200
5059992217,3cyclictest0-21swapper/110:05:311
5059992217,3cyclictest0-21swapper/110:05:311
5059992216,4cyclictest29508-21wc09:45:371
5059992216,4cyclictest29508-21wc09:45:371
5059992216,4cyclictest18974-21head10:45:281
5059992216,4cyclictest18974-21head10:45:281
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional