You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-15 - 08:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack4slot1s.osadl.org (updated Mon Dec 15, 2025 01:37:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2506921320,2sleep30-21swapper/300:02:023
2506921320,2sleep30-21swapper/300:02:023
572321260,2sleep20-21swapper/200:37:022
2985321200,3sleep30-21swapper/321:21:583
2699521180,3sleep30-21swapper/322:41:543
38172940,2chrt0-21swapper/320:11:563
38172940,2chrt0-21swapper/320:11:563
278652840,2sleep20-21swapper/200:11:542
71312810,3chrt0-21swapper/320:21:533
236752680,3chrt0-21swapper/321:06:513
236752680,3chrt0-21swapper/321:06:513
197302680,1sleep3431rcuc/322:21:563
197302680,1sleep3431rcuc/322:21:563
191372670,3chrt0-21swapper/222:21:512
191372670,3chrt0-21swapper/222:21:512
112672640,3sleep30-21swapper/320:31:583
1313499622,19cyclictest23618-21date00:00:050
1313499622,19cyclictest23618-21date00:00:050
56162580,1sleep15722-21/usr/sbin/munin00:37:021
186872580,2sleep30-21swapper/323:46:543
186872580,2sleep30-21swapper/323:46:543
202192570,3sleep30-21swapper/323:51:533
202192570,3sleep30-21swapper/323:51:533
324422530,2chrt32437-21unixbench_multi00:22:021
305112520,1sleep030646-21/usr/sbin/munin00:17:030
305112520,1sleep030646-21/usr/sbin/munin00:17:030
92562510,3sleep20-21swapper/223:21:532
21182510,3chrt0-21swapper/221:35:042
308812500,3sleep30-21swapper/322:51:593
13134994922,24cyclictest13152-21if_wlan023:31:530
168962480,2sleep30-21swapper/320:46:573
73492450,3sleep07353-21fschecks_time23:16:520
13134994316,3cyclictest0-21swapper/020:32:020
1313499431,18cyclictest23707-21latency_hist00:00:080
1313499431,18cyclictest23707-21latency_hist00:00:080
237192420,3sleep20-21swapper/200:00:162
237192420,3sleep20-21swapper/200:00:162
13134994216,5cyclictest29831-21sshd19:55:100
274152410,2sleep027506-21fschecks_time21:16:540
13134994116,2cyclictest0-21swapper/022:26:530
128712410,3sleep20-21swapper/222:02:012
128712410,3sleep20-21swapper/222:02:012
302332400,2sleep20-21swapper/200:17:002
302332400,2sleep20-21swapper/200:17:002
151792400,3sleep20-21swapper/222:10:052
13134994034,4cyclictest13984-21sendmail20:40:030
13134994034,4cyclictest13984-21sendmail20:40:030
13134993912,7cyclictest25956-21kernelversion21:12:030
13134993912,7cyclictest25956-21kernelversion21:12:030
88752380,2sleep013133-21cyclictest20:26:520
88752380,2sleep013133-21cyclictest20:26:520
40952380,3sleep20-21swapper/221:40:062
13134993814,2cyclictest0-21swapper/022:51:540
13134993813,3cyclictest0-21swapper/021:45:110
206262370,1sleep120729-21find20:57:011
13135993727,8cyclictest29609-21cron19:55:031
13134993711,4cyclictest0-21swapper/020:51:550
80052360,2chrt8007-21cat20:22:020
13135993526,7cyclictest14168-21needreboot22:06:581
294012340,1sleep10-21swapper/100:16:511
294012340,1sleep10-21swapper/100:16:511
13135993427,5cyclictest550-21cron23:55:031
13135993427,5cyclictest550-21cron23:55:031
257132330,3sleep20-21swapper/221:12:002
257132330,3sleep20-21swapper/221:12:002
13135993226,4cyclictest23464-21latency_hist00:00:031
13135993226,4cyclictest23464-21latency_hist00:00:031
13134993228,3cyclictest3275-21needreboot00:31:580
13134993228,3cyclictest3275-21needreboot00:31:580
13134993223,7cyclictest23498-21netstat22:31:590
45952310,3sleep20-21swapper/223:07:012
315762310,3sleep20-21swapper/221:26:562
315762310,3sleep20-21swapper/221:26:562
13135993123,6cyclictest7286-21fschecks_count23:16:521
13134993125,4cyclictest1346-21avahi-daemon21:27:000
13134993125,4cyclictest1346-21avahi-daemon21:27:000
246412300,3sleep20-21swapper/222:36:502
246412300,3sleep20-21swapper/222:36:502
13135993025,4cyclictest389-21processes22:56:591
13135993025,4cyclictest389-21processes22:56:591
13135993025,4cyclictest13133-21cyclictest00:11:531
13135993013,4cyclictest181rcu_preempt21:00:201
13135993013,4cyclictest181rcu_preempt21:00:201
44972290,4sleep00-21swapper/021:41:530
44972290,4sleep00-21swapper/021:41:530
13135992921,6cyclictest9629-21latency_hist21:55:061
13135992921,6cyclictest9629-21latency_hist21:55:061
13134992923,4cyclictest31553-21gltestperf00:21:530
13134992923,4cyclictest29106-21threads19:51:590
13134992923,4cyclictest0-21swapper/023:00:030
13134992923,4cyclictest0-21swapper/023:00:030
13134992922,5cyclictest26791-21cut22:41:520
13134992922,5cyclictest13133-21cyclictest21:07:530
13134992922,5cyclictest13133-21cyclictest21:07:530
13134992921,6cyclictest28535-21fschecks_count22:46:510
13134992921,6cyclictest28535-21fschecks_count22:46:510
54102280,1sleep10-21swapper/120:16:521
13135992822,4cyclictest142-21systemd-journal21:09:101
13135992822,4cyclictest142-21systemd-journal21:09:101
13135992822,4cyclictest0-21swapper/100:00:281
13135992822,4cyclictest0-21swapper/100:00:281
13135992822,3cyclictest0-21swapper/119:32:011
13135992821,5cyclictest22214-21sshd22:27:111
13135992820,6cyclictest4302-21latency_hist00:35:051
13135992820,6cyclictest4302-21latency_hist00:35:051
13135992820,6cyclictest13133-21cyclictest21:17:041
13135992819,7cyclictest30674-21tr19:56:581
13135992817,5cyclictest10284-21kworker/u10:0+rpciod23:30:031
13135992817,5cyclictest10284-21kworker/u10:0+rpciod23:30:031
13135992817,3cyclictest181rcu_preempt23:21:531
13134992823,4cyclictest20472-21head23:51:550
13134992823,4cyclictest20472-21head23:51:550
13134992821,5cyclictest24978-21gltestperf22:36:530
13134992821,5cyclictest24978-21gltestperf22:36:530
13134992821,5cyclictest1035-21gltestperf00:26:530
267072270,3chrt0-21swapper/219:46:542
181992270,1sleep3431rcuc/322:17:023
181992270,1sleep3431rcuc/322:17:023
1313599278,12cyclictest90-1pr/ttyS023:13:331
1313599278,12cyclictest90-1pr/ttyS023:13:331
13135992723,3cyclictest16048-21latency_hist23:40:021
13135992723,3cyclictest16048-21latency_hist23:40:021
13135992720,6cyclictest585-21sshd00:25:361
13135992720,5cyclictest18432-21unixbench_singl22:17:031
13135992720,5cyclictest18432-21unixbench_singl22:17:031
13135992719,6cyclictest31775-21ntp_offset21:26:591
13135992719,6cyclictest31775-21ntp_offset21:26:591
13135992718,2cyclictest181rcu_preempt22:21:531
13135992718,2cyclictest181rcu_preempt22:21:531
13134992722,3cyclictest0-21swapper/019:40:030
13134992721,4cyclictest11557-21ntp_kernel_pll_23:26:590
13134992721,4cyclictest11557-21ntp_kernel_pll_23:26:590
13134992720,6cyclictest5716-21netstat20:16:560
13135992622,3cyclictest271rcuc/120:43:421
13135992621,4cyclictest8947-21cut20:26:521
13135992621,4cyclictest8947-21cut20:26:521
13135992620,5cyclictest29457-21timerwakeupswit22:47:011
13135992620,5cyclictest29457-21timerwakeupswit22:47:011
13135992620,3cyclictest0-21swapper/119:36:591
13135992613,4cyclictest181rcu_preempt23:02:011
13135992613,4cyclictest181rcu_preempt23:02:011
13134992621,3cyclictest22200-21latency_hist19:35:020
13134992619,5cyclictest23245-21latency_hist21:05:050
13134992619,5cyclictest23245-21latency_hist21:05:050
13134992619,5cyclictest17796-21sshd23:43:350
13134992619,5cyclictest17796-21sshd23:43:350
13134992618,6cyclictest8846-21mailstats21:51:590
13134992618,6cyclictest8846-21mailstats21:51:590
13134992617,7cyclictest19873-21proc_pri22:21:590
13134992617,7cyclictest19873-21proc_pri22:21:590
13134992617,6cyclictest14549-21fschecks_time20:41:540
258772250,3sleep30-21swapper/321:12:013
258772250,3sleep30-21swapper/321:12:013
255792250,3sleep10-21swapper/121:11:591
255792250,3sleep10-21swapper/121:11:591
1313699256,14cyclictest0-21swapper/200:00:072
1313699256,14cyclictest0-21swapper/200:00:072
13135992521,2cyclictest0-21swapper/122:41:561
13135992517,6cyclictest29926-21ntp_offset21:22:001
13135992517,6cyclictest16426-21fschecks_time20:46:521
13135992517,3cyclictest181rcu_preempt21:42:001
13135992517,3cyclictest181rcu_preempt21:42:001
13135992513,3cyclictest181rcu_preempt20:35:061
13135992511,3cyclictest90-1pr/ttyS020:06:511
13134992521,3cyclictest17509-21head22:16:530
13134992521,3cyclictest17509-21head22:16:530
13134992520,3cyclictest0-21swapper/022:11:520
13134992520,3cyclictest0-21swapper/019:46:510
13134992519,4cyclictest4133-21ntp_kernel_pll_23:06:580
13134992519,3cyclictest0-21swapper/023:46:590
13134992519,3cyclictest0-21swapper/023:46:590
13134992519,3cyclictest0-21swapper/021:56:530
13134992518,5cyclictest30077-21sendmail_mailtr21:22:010
13134992516,7cyclictest20392-21cut20:56:560
1313799241,18cyclictest25905-21chrt22:37:043
1313799241,18cyclictest25905-21chrt22:37:043
1313599249,3cyclictest19167-21unixbench-2d20:52:031
13135992418,3cyclictest0-21swapper/122:40:031
13135992418,3cyclictest0-21swapper/122:40:031
13135992417,5cyclictest26040-21latency_hist19:45:041
13135992417,4cyclictest271rcuc/121:30:461
13135992417,2cyclictest181rcu_preempt20:22:021
13135992416,2cyclictest181rcu_preempt22:35:031
13135992415,2cyclictest181rcu_preempt23:47:011
13135992415,2cyclictest181rcu_preempt23:47:011
13135992413,3cyclictest181rcu_preempt23:06:291
13135992411,3cyclictest181rcu_preempt20:11:401
13135992411,3cyclictest181rcu_preempt20:11:401
13135992411,10cyclictest15362-21/usr/sbin/munin22:11:521
13134992419,3cyclictest0-21swapper/021:31:560
13134992418,4cyclictest0-21swapper/023:01:540
13134992418,4cyclictest0-21swapper/023:01:540
13134992418,3cyclictest0-21swapper/023:21:560
13134992417,5cyclictest5770-21sshd00:37:370
13134992416,6cyclictest13133-21cyclictest22:07:020
1313599235,4cyclictest181rcu_preempt21:35:091
1313599235,4cyclictest181rcu_preempt21:35:091
13135992319,2cyclictest0-21swapper/100:06:541
13135992317,3cyclictest0-21swapper/120:02:001
13135992315,2cyclictest181rcu_preempt23:30:361
13135992314,3cyclictest181rcu_preempt20:35:341
13135992314,3cyclictest181rcu_preempt20:35:341
13135992314,2cyclictest181rcu_preempt19:47:021
13134992318,4cyclictest2650-21gltestperf21:36:540
13134992318,4cyclictest2650-21gltestperf21:36:540
13134992318,3cyclictest0-21swapper/019:41:540
13134992315,6cyclictest12146-21kernelversion22:01:540
13134992315,6cyclictest12146-21kernelversion22:01:540
164252220,3sleep20-21swapper/220:46:522
1313799221,13cyclictest0-21swapper/300:00:063
1313799221,13cyclictest0-21swapper/300:00:063
13135992216,3cyclictest0-21swapper/122:51:541
13135992215,5cyclictest16697-21cut23:41:561
13135992215,5cyclictest16697-21cut23:41:561
13135992214,6cyclictest12286-21sort22:01:561
13135992214,6cyclictest12286-21sort22:01:561
13135992211,4cyclictest181rcu_preempt21:58:531
13134992218,3cyclictest595-21sshd23:35:360
13134992218,3cyclictest595-21sshd23:35:360
13134992217,3cyclictest0-21swapper/020:07:010
13134992216,4cyclictest0-21swapper/020:46:520
13137992115,3cyclictest51232sleep320:16:513
1313699211,12cyclictest15590-21chrt20:42:062
1313499211,8cyclictest276932fschecks_count00:11:530
13134992116,3cyclictest0-21swapper/000:07:010
13134992115,4cyclictest0-21swapper/023:11:540
13134992115,4cyclictest0-21swapper/023:11:540
13134992115,3cyclictest0-21swapper/020:11:520
13134992115,3cyclictest0-21swapper/020:11:520
30242200,2sleep20-21swapper/221:36:572
13135992013,2cyclictest181rcu_preempt21:46:581
154642190,3sleep20-21swapper/222:11:502
13136991912,4cyclictest10838-21chrt20:31:532
1313799183,9cyclictest0-21swapper/319:38:113
1313799181,11cyclictest19224-21taskset20:52:043
1313699181,12cyclictest25420-21chrt19:42:042
1313499187,9cyclictest31832-21/usr/sbin/munin20:01:560
1313799173,9cyclictest0-21swapper/320:28:113
1313799173,9cyclictest0-21swapper/320:28:113
1313799172,11cyclictest5860-21chrt23:11:573
1313799172,11cyclictest5860-21chrt23:11:573
1313799172,11cyclictest0-21swapper/300:21:563
1313799171,12cyclictest26352-21chrt19:46:513
1313799171,11cyclictest26480-21taskset00:07:003
1313799171,11cyclictest14824-21chrt23:36:533
1313799171,11cyclictest14824-21chrt23:36:533
1313699171,12cyclictest27651-21taskset22:42:012
1313699171,12cyclictest23395-21taskset21:05:052
1313699171,12cyclictest23395-21taskset21:05:052
1313699171,11cyclictest4312-21chrt00:35:052
1313699171,11cyclictest28966-21chrt21:20:042
1313699171,11cyclictest20732-21taskset20:57:012
1313699170,13cyclictest2813-21chrt23:02:032
1313699170,13cyclictest2813-21chrt23:02:032
101052171,2sleep20-21swapper/220:28:162
101052171,2sleep20-21swapper/220:28:162
1313799161,11cyclictest12841-21chrt23:31:513
1313799161,10cyclictest20851-21chrt20:57:023
1313699162,10cyclictest13290-21taskset20:36:592
1313699162,10cyclictest13290-21taskset20:36:592
1313699161,11cyclictest7485-21chrt20:21:562
1313699161,11cyclictest7327-21chrt21:47:022
1313699161,11cyclictest30378-21chrt22:51:542
1313799151,9cyclictest0-21swapper/321:25:103
1313799151,9cyclictest0-21swapper/321:25:103
1313799151,8cyclictest0-21swapper/322:05:053
1313799151,8cyclictest0-21swapper/322:05:053
1313799151,10cyclictest3902-21chrt23:06:543
1313799151,10cyclictest31834-21chrt20:01:513
1313799151,10cyclictest20797-21chrt19:31:523
1313799151,10cyclictest10918-21taskset23:26:523
1313799151,10cyclictest10918-21taskset23:26:523
1313799151,10cyclictest0-21swapper/321:51:533
1313799151,10cyclictest0-21swapper/321:51:533
1313699152,8cyclictest0-21swapper/221:06:532
1313699152,8cyclictest0-21swapper/221:06:532
1313699152,10cyclictest0-21swapper/222:17:022
1313699152,10cyclictest0-21swapper/222:17:022
1313699151,11cyclictest491-21chrt20:02:022
1313699151,11cyclictest0-21swapper/222:31:522
1313699151,10cyclictest8978-21chrt21:52:002
1313699151,10cyclictest8978-21chrt21:52:002
1313699151,10cyclictest15179-21chrt23:36:562
1313699151,10cyclictest15179-21chrt23:36:562
1313699151,10cyclictest0-21swapper/200:31:572
124712151,2sleep20-21swapper/223:30:062
124712151,2sleep20-21swapper/223:30:062
1313799149,3cyclictest126722chrt20:36:523
1313799149,3cyclictest126722chrt20:36:523
1313799147,3cyclictest6752chrt00:26:423
1313799141,9cyclictest4409-21chrt00:36:113
1313799141,9cyclictest32748-21chrt21:30:063
1313799141,9cyclictest30860-21chrt19:57:003
1313799141,9cyclictest29297-21chrt00:15:403
1313799141,9cyclictest29297-21chrt00:15:403
1313799141,9cyclictest27213-21chrt21:15:393
1313799141,9cyclictest24282-21chrt19:40:083
1313799141,9cyclictest0-21swapper/322:33:113
1313799141,11cyclictest0-21swapper/322:15:023
1313799141,10cyclictest5116-21chrt21:42:003
1313799141,10cyclictest5116-21chrt21:42:003
1313699149,3cyclictest291212chrt21:21:012
1313699142,7cyclictest0-21swapper/223:11:562
1313699142,7cyclictest0-21swapper/223:11:562
1313699142,7cyclictest0-21swapper/221:41:512
1313699142,7cyclictest0-21swapper/221:41:512
1313699141,9cyclictest28258-21chrt22:45:272
1313699141,9cyclictest28258-21chrt22:45:272
1313699141,9cyclictest0-21swapper/219:52:102
1313699141,10cyclictest3238-21chrt20:11:512
1313699141,10cyclictest3238-21chrt20:11:512
1313699141,10cyclictest21931-21chrt19:32:032
1313699141,10cyclictest20094-21chrt23:51:352
1313699141,10cyclictest20094-21chrt23:51:352
1313699141,10cyclictest1551-21chrt20:06:522
273232130,3sleep20-21swapper/200:10:052
1313799138,3cyclictest59992chrt21:45:423
1313799138,3cyclictest319562chrt22:55:293
1313799138,3cyclictest319562chrt22:55:293
1313799138,3cyclictest30222chrt23:04:333
1313799138,3cyclictest30222chrt23:04:333
1313799138,3cyclictest223882chrt22:29:243
1313799131,9cyclictest30062-21chrt22:50:063
1313799131,9cyclictest28002-21chrt19:50:253
1313799131,9cyclictest2546-21chrt20:07:013
1313799131,9cyclictest2306-21chrt21:36:053
1313799131,9cyclictest2306-21chrt21:36:053
1313799131,8cyclictest27418-21chrt00:10:183
1313799131,8cyclictest21610-21taskset21:00:083
1313799131,8cyclictest21610-21taskset21:00:083
1313799131,8cyclictest16300-21chrt23:40:233
1313799131,8cyclictest16300-21chrt23:40:233
1313699138,3cyclictest312542chrt00:21:382
1313699138,3cyclictest298632chrt19:55:352
1313699131,9cyclictest7060-21chrt23:16:102
1313699131,9cyclictest17969-21chrt20:51:102
1313699131,9cyclictest16378-21chrt23:41:222
1313699131,9cyclictest16378-21chrt23:41:222
1313699131,9cyclictest0-21swapper/221:56:542
1313699131,10cyclictest12789-21chrt23:31:502
1313699131,10cyclictest1032-21taskset00:26:532
1313799128,2cyclictest0-21swapper/322:05:243
1313799127,3cyclictest282302chrt22:45:083
1313799121,9cyclictest14323-21chrt20:41:513
1313799121,9cyclictest10424-21chrt23:24:153
1313799121,8cyclictest7222-21taskset23:16:513
1313799121,7cyclictest9651-21taskset21:55:073
1313799121,7cyclictest2477-21taskset00:30:083
1313799121,7cyclictest2477-21taskset00:30:083
1313699121,8cyclictest4891-21chrt20:15:122
1313699121,8cyclictest22415-21chrt19:35:132
1313699121,8cyclictest20809-21chrt22:25:092
1313699121,8cyclictest18150-21chrt23:45:242
1313699121,8cyclictest18150-21chrt23:45:242
1313699121,7cyclictest0-21swapper/222:56:512
1313699121,7cyclictest0-21swapper/222:56:512
plot09:55:358
setyrange[0.8:*]5
setylabel"Numberoflatencysamples"6
setxrange[0:400]4
setxlabel"Latencyus-Maximumusplottedon2
settitle"Latencyrack4slot1s"0
setterminalpbmcolor1
setoutput"r4s1s.ppm"7
setlogscaley3
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional