You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-21 - 23:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Thu May 21, 2026 12:49:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2823721280,2chrt28238-21grep08:12:440
2823721280,2chrt28238-21grep08:12:440
2005221120,2chrt20051-21ntp_states10:42:481
2005221120,2chrt20051-21ntp_states10:42:481
2005221120,2chrt20051-21ntp_states10:42:481
52732980,3sleep30-21swapper/310:02:543
52732980,3sleep30-21swapper/310:02:543
52732980,3sleep30-21swapper/310:02:543
304912830,4sleep30-21swapper/308:17:503
304912830,4sleep30-21swapper/308:17:503
278212780,7chrt27824-21grep11:02:530
278212780,7chrt27824-21grep11:02:530
183042780,2sleep30-21swapper/309:12:453
183042780,2sleep30-21swapper/309:12:453
183042780,2sleep30-21swapper/309:12:453
306082630,4chrt0-21swapper/312:37:473
306082630,4chrt0-21swapper/312:37:473
235942570,3chrt0-21swapper/310:52:473
235942570,3chrt0-21swapper/310:52:473
235942570,3chrt0-21swapper/310:52:473
81582460,4sleep30-21swapper/310:12:433
81582460,4sleep30-21swapper/310:12:433
274622450,2sleep027463-21df09:37:430
114412450,2chrt0-21swapper/008:52:520
114412450,2chrt0-21swapper/008:52:520
114412450,2chrt0-21swapper/008:52:520
260782400,3sleep30-21swapper/310:57:543
260782400,3sleep30-21swapper/310:57:543
5771993931,6cyclictest30786-21fschecks_time11:12:440
323892390,2sleep032390-21cat12:42:470
323892390,2sleep032390-21cat12:42:470
323892390,2sleep032390-21cat12:42:470
323892390,2sleep032390-21cat12:42:470
9972380,2sleep11197-21grep11:17:551
9972380,2sleep11197-21grep11:17:551
9972380,2sleep11197-21grep11:17:551
5771993824,12cyclictest0-21swapper/008:42:430
5771993824,12cyclictest0-21swapper/008:42:430
225372380,2sleep022534-21ntp_states09:22:510
225372380,2sleep022534-21ntp_states09:22:510
94012370,2chrt9405-21fschecks_count07:22:430
5771993728,7cyclictest26015-21latency_hist12:27:320
5771993728,7cyclictest26015-21latency_hist12:27:320
5771993728,7cyclictest26015-21latency_hist12:27:320
5771993728,6cyclictest27837-21if_wlan009:37:460
5771993728,6cyclictest27837-21if_wlan009:37:460
8642360,2chrt858-21mailstats11:17:530
8642360,2chrt858-21mailstats11:17:530
8642360,2chrt858-21mailstats11:17:530
5771993630,4cyclictest572-21cups-browsed10:12:510
5771993630,4cyclictest572-21cups-browsed10:12:510
5771993630,4cyclictest572-21cups-browsed10:12:510
5771993627,7cyclictest23021-21netstat07:57:500
5771993627,7cyclictest23021-21netstat07:57:500
27622360,3sleep20-21swapper/211:22:532
27622360,3sleep20-21swapper/211:22:532
118532360,3sleep20-21swapper/207:27:522
118532360,3sleep20-21swapper/207:27:522
115552360,2sleep111762-21grep08:52:541
115552360,2sleep111762-21grep08:52:541
115552360,2sleep111762-21grep08:52:541
5773993426,6cyclictest5770-21cyclictest10:27:421
5773993426,6cyclictest5770-21cyclictest10:27:421
5773993426,6cyclictest5770-21cyclictest10:27:421
5773993426,6cyclictest5770-21cyclictest10:27:421
243722340,2chrt0-21swapper/008:02:430
243722340,2chrt0-21swapper/008:02:430
243722340,2chrt0-21swapper/008:02:430
5773993325,6cyclictest31964-21fschecks_count12:42:441
5773993325,6cyclictest31964-21fschecks_count12:42:441
5773993325,5cyclictest17867-21switchtime12:02:521
5773993325,5cyclictest17867-21switchtime12:02:521
5773993325,5cyclictest17867-21switchtime12:02:521
5771993328,3cyclictest5770-21cyclictest12:12:440
5771993328,3cyclictest17575-21fschecks_count10:37:440
5771993328,3cyclictest17575-21fschecks_count10:37:440
5771993328,3cyclictest17575-21fschecks_count10:37:440
5771993324,7cyclictest5561-21latency_hist11:32:400
5771993324,7cyclictest5561-21latency_hist11:32:400
106112330,3sleep30-21swapper/310:17:503
62052320,3sleep20-21swapper/211:32:472
62052320,3sleep20-21swapper/211:32:472
5773993223,7cyclictest30595-21processes08:17:521
5773993223,7cyclictest30595-21processes08:17:521
5773993220,10cyclictest16355-21fschecks_time09:07:441
5773993220,10cyclictest16355-21fschecks_time09:07:441
5773993220,10cyclictest16355-21fschecks_time09:07:441
5771993224,6cyclictest32661-21cut11:17:440
5771993224,6cyclictest29169-21/usr/sbin/munin09:42:480
5771993224,6cyclictest29169-21/usr/sbin/munin09:42:480
184742320,2sleep018587-21grep09:12:470
184742320,2sleep018587-21grep09:12:470
5773993125,4cyclictest14678-21systemd-journal09:27:311
5773993125,4cyclictest14678-21systemd-journal09:27:311
5773993122,7cyclictest26454-21fschecks_time12:27:441
5773993122,7cyclictest26454-21fschecks_time12:27:441
5773993122,7cyclictest26454-21fschecks_time12:27:441
5773993025,3cyclictest0-21swapper/107:42:311
5773993025,3cyclictest0-21swapper/107:42:311
5773993023,6cyclictest10400-21threads11:42:541
5773993023,6cyclictest10400-21threads11:42:541
5773993023,6cyclictest10400-21threads11:42:541
5773993023,6cyclictest10400-21threads11:42:541
5773993023,5cyclictest24731-21latency08:02:471
5773993023,5cyclictest24731-21latency08:02:471
5773993023,5cyclictest24731-21latency08:02:471
5773993023,5cyclictest23208-21ntp_offset12:17:521
5773993023,5cyclictest23208-21ntp_offset12:17:521
5773993023,5cyclictest23208-21ntp_offset12:17:521
5773993023,5cyclictest21589-21latency_hist09:22:321
5773993023,5cyclictest21589-21latency_hist09:22:321
5773993021,7cyclictest8253-21cut10:12:431
5773993021,7cyclictest8253-21cut10:12:431
5771993025,3cyclictest0-21swapper/009:02:520
5771993025,3cyclictest0-21swapper/009:02:520
5771993023,5cyclictest5770-21cyclictest08:32:450
5771993023,5cyclictest5770-21cyclictest08:32:450
5771993023,5cyclictest12819-21sshd07:32:360
5771993023,5cyclictest12819-21sshd07:32:360
5771993022,6cyclictest16707-21ls09:07:470
5771993022,6cyclictest16707-21ls09:07:470
5771993022,6cyclictest16707-21ls09:07:470
5771993018,10cyclictest21303-21processes07:52:510
48372300,2sleep04849-21cat08:37:420
48372300,2sleep04849-21cat08:37:420
5784992923,3cyclictest190132chrt12:07:432
5784992923,3cyclictest190132chrt12:07:432
5773992921,6cyclictest550-21cron07:47:431
5773992921,6cyclictest550-21cron07:47:431
5773992921,6cyclictest18504-21sshd07:47:381
5773992921,6cyclictest18504-21sshd07:47:381
5773992921,6cyclictest18504-21sshd07:47:381
5773992920,7cyclictest22375-21unixbench_multi10:47:541
5773992920,7cyclictest22375-21unixbench_multi10:47:541
5773992920,7cyclictest22375-21unixbench_multi10:47:541
577199292,9cyclictest233872grep10:52:450
577199292,9cyclictest233872grep10:52:450
577199292,9cyclictest233872grep10:52:450
5771992925,2cyclictest0-21swapper/012:32:540
5771992925,2cyclictest0-21swapper/012:32:540
5771992925,2cyclictest0-21swapper/012:32:540
5771992923,4cyclictest0-21swapper/010:37:530
5771992923,4cyclictest0-21swapper/010:37:530
5771992923,4cyclictest0-21swapper/010:37:530
5771992923,3cyclictest0-21swapper/008:12:390
5771992923,3cyclictest0-21swapper/008:12:390
5771992922,5cyclictest18530-21wc12:07:310
5771992922,5cyclictest18530-21wc12:07:310
5771992922,5cyclictest18530-21wc12:07:310
5771992921,6cyclictest7436-21unixbench_singl10:07:560
5771992921,6cyclictest7436-21unixbench_singl10:07:560
5771992921,6cyclictest24871-21unixbench_singl09:27:540
5771992921,6cyclictest24871-21unixbench_singl09:27:540
27202297,15sleep10-21swapper/112:50:061
27202297,15sleep10-21swapper/112:50:061
244462290,3sleep20-21swapper/212:22:432
244462290,3sleep20-21swapper/212:22:432
9642287,14sleep10-21swapper/112:46:311
9642287,14sleep10-21swapper/112:46:311
5773992824,2cyclictest0-21swapper/108:17:311
5773992824,2cyclictest0-21swapper/108:17:311
5773992820,6cyclictest29601-21sort09:42:431
5773992820,6cyclictest29601-21sort09:42:431
5773992817,7cyclictest17063-21fschecks_count12:02:431
5773992817,7cyclictest17063-21fschecks_count12:02:431
5771992824,3cyclictest20902-21gltestperf12:12:450
5771992824,3cyclictest20902-21gltestperf12:12:450
5771992824,3cyclictest20902-21gltestperf12:12:450
5771992822,4cyclictest3502-21latency_hist11:27:320
5771992822,4cyclictest3502-21latency_hist11:27:320
5771992822,4cyclictest0-21swapper/008:27:540
5771992822,4cyclictest0-21swapper/008:27:540
5771992821,5cyclictest10503-21latency_hist08:52:400
5771992821,5cyclictest0-21swapper/007:37:420
5771992821,5cyclictest0-21swapper/007:37:420
5771992819,7cyclictest16290-21netstat10:32:510
5773992723,3cyclictest10680-21ntp_offset10:17:511
5773992723,3cyclictest10680-21ntp_offset10:17:511
5773992723,3cyclictest10680-21ntp_offset10:17:511
5773992723,3cyclictest10680-21ntp_offset10:17:511
5773992722,3cyclictest0-21swapper/110:02:321
5773992722,3cyclictest0-21swapper/110:02:321
5773992722,3cyclictest0-21swapper/110:02:321
5773992721,4cyclictest5770-21cyclictest08:32:551
5773992721,4cyclictest5770-21cyclictest08:32:551
5773992721,4cyclictest30891-21latency_hist11:12:441
5773992720,5cyclictest8032-21latency11:37:471
5771992721,5cyclictest18766-21fschecks_count07:47:440
5771992721,5cyclictest18766-21fschecks_count07:47:440
5771992721,4cyclictest4789-21kernelversion10:02:470
5771992721,4cyclictest4789-21kernelversion10:02:470
5771992721,4cyclictest4789-21kernelversion10:02:470
5771992721,4cyclictest0-21swapper/009:52:540
5771992721,4cyclictest0-21swapper/009:52:540
5771992719,6cyclictest20905-21threads09:17:540
5771992719,6cyclictest20905-21threads09:17:540
5771992719,6cyclictest20380-21latency_hist12:12:380
5773992619,5cyclictest5745-21fschecks_count11:32:421
5773992619,5cyclictest5745-21fschecks_count11:32:421
5773992619,5cyclictest32387-21grep08:22:481
5773992619,5cyclictest32387-21grep08:22:481
5773992619,4cyclictest26796-21ntp_offset08:07:501
5773992619,4cyclictest26796-21ntp_offset08:07:501
5773992618,6cyclictest19768-21latency_hist09:17:371
5773992618,6cyclictest19768-21latency_hist09:17:371
5771992621,3cyclictest0-21swapper/010:22:450
5771992621,3cyclictest0-21swapper/010:22:450
5771992621,3cyclictest0-21swapper/010:22:450
5771992621,3cyclictest0-21swapper/010:22:450
5771992619,5cyclictest26921-21fschecks_count11:02:430
5771992619,5cyclictest26921-21fschecks_count11:02:430
5771992618,6cyclictest5770-21cyclictest10:27:520
5771992618,6cyclictest5770-21cyclictest10:27:520
5771992615,9cyclictest7249-21cron11:37:310
5771992615,9cyclictest7249-21cron11:37:310
26412263,16sleep30-21swapper/312:49:153
26412263,16sleep30-21swapper/312:49:153
26412263,16sleep30-21swapper/312:49:153
26412263,16sleep30-21swapper/312:49:153
5784992515,6cyclictest28344-21chrt11:06:212
5784992515,6cyclictest28344-21chrt11:06:212
5784992514,8cyclictest9643-21chrt10:16:362
5784992514,8cyclictest9643-21chrt10:16:362
5784992514,8cyclictest9643-21chrt10:16:362
5773992520,3cyclictest0-21swapper/109:32:321
5773992520,3cyclictest0-21swapper/109:32:321
5773992518,5cyclictest27405-21unixbench_multi12:27:531
5773992518,5cyclictest27405-21unixbench_multi12:27:531
5773992518,5cyclictest27396-21missed_timers11:02:471
5773992518,5cyclictest27396-21missed_timers11:02:471
5773992516,6cyclictest2939-21latency_hist08:32:401
5773992516,6cyclictest2939-21latency_hist08:32:401
5773992514,9cyclictest14678-21systemd-journal11:17:311
5773992514,9cyclictest14678-21systemd-journal11:17:311
5771992521,2cyclictest0-21swapper/007:32:440
5771992521,2cyclictest0-21swapper/007:32:440
5771992519,4cyclictest27856-21latency_hist12:32:410
5771992519,4cyclictest27856-21latency_hist12:32:410
5771992519,4cyclictest0-21swapper/011:57:410
5771992519,4cyclictest0-21swapper/011:57:410
5771992519,4cyclictest0-21swapper/011:57:410
5771992519,4cyclictest0-21swapper/010:27:490
5771992519,4cyclictest0-21swapper/010:27:490
5771992519,4cyclictest0-21swapper/010:27:490
5771992519,4cyclictest0-21swapper/010:27:490
25712252,17sleep20-21swapper/212:48:222
25712252,17sleep20-21swapper/212:48:222
25712252,17sleep20-21swapper/212:48:222
25712252,17sleep20-21swapper/212:48:222
92402240,2sleep10-21swapper/110:12:531
92402240,2sleep10-21swapper/110:12:531
92402240,2sleep10-21swapper/110:12:531
5784992413,8cyclictest24018-21chrt12:21:222
5784992413,8cyclictest22540-21chrt10:48:482
5784992413,8cyclictest22540-21chrt10:48:482
5784992413,8cyclictest22540-21chrt10:48:482
5784992413,8cyclictest1283-21chrt11:18:352
5784992413,8cyclictest1283-21chrt11:18:352
5784992413,8cyclictest1283-21chrt11:18:352
5784992412,8cyclictest25250-21chrt09:32:102
5784992412,8cyclictest25250-21chrt09:32:102
5784992412,8cyclictest14737-21chrt11:57:062
5784992412,8cyclictest14737-21chrt11:57:062
5784992412,8cyclictest14737-21chrt11:57:062
577399249,3cyclictest181rcu_preempt11:57:451
5773992419,3cyclictest0-21swapper/112:37:431
5773992419,3cyclictest0-21swapper/112:37:431
5773992419,3cyclictest0-21swapper/112:37:431
5773992419,3cyclictest0-21swapper/110:32:461
5773992419,3cyclictest0-21swapper/110:32:461
5773992419,3cyclictest0-21swapper/110:32:461
5773992417,5cyclictest20522-21latency_hist12:12:401
5773992417,5cyclictest20522-21latency_hist12:12:401
5773992416,5cyclictest3855-21fschecks_count11:27:441
5773992416,5cyclictest3855-21fschecks_count11:27:441
5773992415,7cyclictest13843-21grep07:32:521
5773992415,7cyclictest13843-21grep07:32:521
5771992420,2cyclictest0-21swapper/011:52:430
5771992420,2cyclictest0-21swapper/008:47:480
5771992419,3cyclictest0-21swapper/012:42:450
5771992419,3cyclictest0-21swapper/010:47:320
5771992419,3cyclictest0-21swapper/010:47:320
5771992419,3cyclictest0-21swapper/010:47:320
5771992419,3cyclictest0-21swapper/009:57:520
5771992419,3cyclictest0-21swapper/009:57:520
5771992419,3cyclictest0-21swapper/009:57:520
5771992418,4cyclictest0-21swapper/011:57:460
5771992418,4cyclictest0-21swapper/011:57:460
5771992418,4cyclictest0-21swapper/011:57:460
5771992418,3cyclictest0-21swapper/010:47:500
5771992418,3cyclictest0-21swapper/010:47:500
5771992418,3cyclictest0-21swapper/010:47:500
5771992417,5cyclictest5770-21cyclictest09:00:200
5771992417,5cyclictest5770-21cyclictest09:00:200
5771992417,5cyclictest5770-21cyclictest09:00:200
5771992416,6cyclictest27226-21latency_hist09:37:350
5771992416,6cyclictest16869-21fschecks_count07:42:430
5771992416,6cyclictest16869-21fschecks_count07:42:430
5771992416,6cyclictest16869-21fschecks_count07:42:430
5771992416,5cyclictest0-21swapper/008:22:530
5771992416,5cyclictest0-21swapper/008:22:530
5771992412,10cyclictest31285-21fschecks_count09:47:460
5771992412,10cyclictest31285-21fschecks_count09:47:460
5784992314,6cyclictest19854-21chrt09:17:432
5784992314,6cyclictest19854-21chrt09:17:432
5784992314,6cyclictest16360-21chrt11:58:592
5784992314,6cyclictest16360-21chrt11:58:592
5784992314,6cyclictest16360-21chrt11:58:592
5784992313,7cyclictest26233-21chrt10:58:252
5784992313,7cyclictest26233-21chrt10:58:252
5784992313,7cyclictest20122-21chrt07:51:122
5784992313,7cyclictest20122-21chrt07:51:122
5784992313,7cyclictest18288-21chrt07:46:332
5784992313,7cyclictest18288-21chrt07:46:332
5784992313,7cyclictest18288-21chrt07:46:332
5784992313,7cyclictest10770-21chrt11:44:162
5784992313,7cyclictest10770-21chrt11:44:162
5784992313,7cyclictest10770-21chrt11:44:162
5784992313,7cyclictest10770-21chrt11:44:162
5784992313,6cyclictest25982-21chrt12:27:252
5784992313,6cyclictest25982-21chrt12:27:252
5784992313,6cyclictest25982-21chrt12:27:252
5784992313,6cyclictest23123-21chrt09:23:422
5784992313,6cyclictest23123-21chrt09:23:422
5784992312,8cyclictest28919-21chrt09:41:312
5784992312,8cyclictest28919-21chrt09:41:312
5784992312,7cyclictest7792-21chrt10:12:062
5784992312,7cyclictest7792-21chrt10:12:062
5784992312,7cyclictest2569-21chrt08:30:112
5784992312,7cyclictest2569-21chrt08:30:112
5784992312,7cyclictest15261-21chrt10:31:152
5784992312,7cyclictest15261-21chrt10:31:152
5784992312,7cyclictest15261-21chrt10:31:152
5784992312,6cyclictest18908-21chrt10:40:162
5784992312,6cyclictest18908-21chrt10:40:162
5784992312,6cyclictest18908-21chrt10:40:162
5773992319,3cyclictest27043-21fschecks_time11:02:441
5773992318,3cyclictest0-21swapper/110:02:561
5773992318,3cyclictest0-21swapper/110:02:561
5773992318,3cyclictest0-21swapper/110:02:561
5773992317,5cyclictest29516-21rt-features11:07:511
5773992316,5cyclictest8563-21latency_hist08:47:391
5773992316,5cyclictest8563-21latency_hist08:47:391
5773992316,5cyclictest0-21swapper/108:47:541
5773992316,5cyclictest0-21swapper/108:47:541
577399230,3cyclictest9405-21fschecks_count07:22:431
5771992318,3cyclictest0-21swapper/012:17:530
5771992318,3cyclictest0-21swapper/012:17:530
5771992318,3cyclictest0-21swapper/012:17:530
5771992315,6cyclictest12932-21latency_hist11:52:340
267712230,3sleep30-21swapper/309:32:553
267712230,3sleep30-21swapper/309:32:553
5784992213,7cyclictest21175-21chrt09:17:592
5784992213,7cyclictest21175-21chrt09:17:592
5784992213,6cyclictest8888-21chrt11:39:372
5784992213,6cyclictest32505-21chrt09:49:262
5784992213,6cyclictest32505-21chrt09:49:262
5784992213,6cyclictest31249-21chrt08:20:142
5784992213,6cyclictest31249-21chrt08:20:142
5784992213,6cyclictest27667-21chrt08:12:102
5784992213,6cyclictest27667-21chrt08:12:102
5784992213,6cyclictest13165-21chrt10:23:362
5784992213,6cyclictest13165-21chrt10:23:362
5784992213,6cyclictest13165-21chrt10:23:362
5784992213,6cyclictest13165-21chrt10:23:362
5784992213,6cyclictest11465-21chrt10:20:582
5784992213,6cyclictest11465-21chrt10:20:582
5784992213,6cyclictest11465-21chrt10:20:582
5784992213,6cyclictest11465-21chrt10:20:582
5784992212,7cyclictest31815-21chrt11:13:042
5784992212,7cyclictest31815-21chrt11:13:042
5784992212,7cyclictest29992-21chrt11:08:342
5784992212,7cyclictest29992-21chrt11:08:342
5784992212,7cyclictest21993-21chrt07:56:182
5784992212,7cyclictest13869-21chrt09:00:222
5784992212,7cyclictest13869-21chrt09:00:222
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional