You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-01 - 02:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Wed Apr 01, 2026 00:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
119221090,3sleep11195-21unixbench-2d20:27:101
119221090,3sleep11195-21unixbench-2d20:27:101
54242810,2sleep10-21swapper/120:41:451
54242810,2sleep10-21swapper/120:41:451
321612640,3sleep00-21swapper/021:51:590
126542600,2sleep10-21swapper/120:58:501
126542600,2sleep10-21swapper/120:58:501
126542600,2sleep10-21swapper/120:58:501
164062460,3sleep00-21swapper/000:02:040
164062460,3sleep00-21swapper/000:02:040
110142460,3chrt0-21swapper/223:47:062
110142460,3chrt0-21swapper/223:47:062
213062420,2sleep121439-21fschecks_time19:57:001
213062420,2sleep121439-21fschecks_time19:57:001
4483993931,6cyclictest3614-21threads23:27:070
4483993931,6cyclictest3614-21threads23:27:070
4483993833,3cyclictest11586-21cut20:56:590
4483993833,3cyclictest11586-21cut20:56:590
4483993833,3cyclictest11586-21cut20:56:590
4483993831,5cyclictest16765-21kernelversion22:36:590
4483993831,5cyclictest16765-21kernelversion22:36:590
4483993826,9cyclictest4474-21netstat20:37:020
4483993826,9cyclictest4474-21netstat20:37:020
4483993732,3cyclictest30329-21latency_hist20:21:450
4483993732,3cyclictest30329-21latency_hist20:21:450
4483993732,3cyclictest30329-21latency_hist20:21:450
4483993731,4cyclictest24502-21sshd22:57:060
4483993731,4cyclictest24502-21sshd22:57:060
4483993730,6cyclictest404-21sendmail23:21:440
4483993730,6cyclictest404-21sendmail23:21:440
4483993631,3cyclictest28445-21latency_hist20:16:450
4483993528,5cyclictest20518-21kernelversion00:17:000
4483993528,5cyclictest20518-21kernelversion00:17:000
4483993528,5cyclictest20518-21kernelversion00:17:000
4483993526,3cyclictest181rcu_preempt23:26:110
4483993526,3cyclictest181rcu_preempt23:26:110
184802350,2sleep10-21swapper/119:47:071
184802350,2sleep10-21swapper/119:47:071
157792350,2sleep30-21swapper/319:41:573
157792350,2sleep30-21swapper/319:41:573
4486993324,7cyclictest9803-21threads22:17:051
4486993324,7cyclictest9803-21threads22:17:051
4486993320,2cyclictest181rcu_preempt20:44:521
4486993319,4cyclictest90-1pr/ttyS022:34:581
4486993319,4cyclictest90-1pr/ttyS022:34:581
4483993329,3cyclictest90-1pr/ttyS023:33:080
4483993329,3cyclictest90-1pr/ttyS023:33:080
4486993227,4cyclictest4482-21cyclictest00:02:361
4486993227,4cyclictest4482-21cyclictest00:02:361
4486993226,4cyclictest25601-21strings20:07:021
4486993226,4cyclictest25601-21strings20:07:021
4486993218,5cyclictest90-1pr/ttyS023:36:561
4486993218,5cyclictest90-1pr/ttyS023:36:561
4486993217,2cyclictest181rcu_preempt20:32:051
4486993217,2cyclictest181rcu_preempt20:32:051
4483993225,5cyclictest22988-21kernelversion21:27:000
4483993225,5cyclictest22988-21kernelversion21:27:000
4483993225,5cyclictest22988-21kernelversion21:27:000
4483993222,7cyclictest0-21swapper/021:21:490
4483993222,7cyclictest0-21swapper/021:21:490
4483993215,4cyclictest171ktimers/019:47:020
4483993215,4cyclictest171ktimers/019:47:020
4483993211,5cyclictest201rcuc/020:35:330
4483993211,5cyclictest201rcuc/020:35:330
311932320,2sleep3431rcuc/320:22:013
311932320,2sleep3431rcuc/320:22:013
4486993125,5cyclictest19750-21sshd00:16:121
4486993125,5cyclictest19750-21sshd00:16:121
4486993125,4cyclictest15519-21latency_hist00:01:471
4486993125,4cyclictest15519-21latency_hist00:01:471
4486993125,4cyclictest15519-21latency_hist00:01:471
4486993125,3cyclictest0-21swapper/119:46:451
4486993125,3cyclictest0-21swapper/119:46:451
4486993124,4cyclictest1648-21ntpd22:22:061
4486993124,4cyclictest1648-21ntpd22:22:061
4486993123,6cyclictest21327-21netstat21:22:021
4486993123,6cyclictest21327-21netstat21:22:021
4483993126,3cyclictest0-21swapper/021:42:060
4483993126,3cyclictest0-21swapper/021:42:060
4483993126,3cyclictest0-21swapper/021:42:060
4483993125,4cyclictest8182-21tail20:47:010
4483993125,4cyclictest8182-21tail20:47:010
4483993124,4cyclictest171ktimers/023:06:070
4483993124,4cyclictest171ktimers/023:06:070
4483993124,4cyclictest0-21swapper/022:31:570
4483993124,4cyclictest0-21swapper/022:31:570
4483993115,4cyclictest90-1pr/ttyS019:21:590
4483993115,4cyclictest171ktimers/022:07:090
4483993111,4cyclictest201rcuc/020:31:330
4483993111,4cyclictest201rcuc/020:31:330
448699308,10cyclictest29-21ksoftirqd/122:09:211
4486993026,2cyclictest0-21swapper/123:31:441
4486993026,2cyclictest0-21swapper/123:31:441
4486993024,4cyclictest24135-21gltestperf00:27:001
4486993024,4cyclictest24135-21gltestperf00:27:001
4486993024,4cyclictest10173-21fschecks_count19:26:581
4486993023,5cyclictest749-21runrttasks00:22:051
4486993023,5cyclictest749-21runrttasks00:22:051
4486993023,5cyclictest4482-21cyclictest21:31:551
4486993023,5cyclictest4482-21cyclictest21:31:551
4486993022,6cyclictest16975-21netstat22:37:021
4486993022,6cyclictest16975-21netstat22:37:021
4486993022,6cyclictest12764-21fschecks_time22:26:581
4486993016,8cyclictest90-1pr/ttyS021:17:061
4486993016,8cyclictest90-1pr/ttyS021:17:061
4486993011,3cyclictest0-21swapper/123:42:241
4486993011,3cyclictest0-21swapper/123:42:241
4483993024,4cyclictest171ktimers/021:03:040
4483993024,4cyclictest171ktimers/021:03:040
4483993024,4cyclictest0-21swapper/023:52:070
4483993024,4cyclictest0-21swapper/023:52:070
4483993024,3cyclictest0-21swapper/000:01:570
4483993024,3cyclictest0-21swapper/000:01:570
4483993022,6cyclictest15077-21sshd19:38:060
4483993022,6cyclictest15077-21sshd19:38:060
4483993022,6cyclictest15077-21sshd19:38:060
4483993017,4cyclictest90-1pr/ttyS000:31:590
4483993017,4cyclictest90-1pr/ttyS000:31:590
4483993015,4cyclictest90-1pr/ttyS000:31:440
4483993015,4cyclictest90-1pr/ttyS000:31:440
4483993015,4cyclictest90-1pr/ttyS000:11:560
4483993015,4cyclictest90-1pr/ttyS000:11:560
448799291,24cyclictest15560-21taskset00:01:492
448799291,24cyclictest15560-21taskset00:01:492
448799291,24cyclictest15560-21taskset00:01:492
4486992922,5cyclictest23809-21ntp_offset20:02:031
4486992922,5cyclictest23809-21ntp_offset20:02:031
4486992918,2cyclictest181rcu_preempt23:14:331
4486992915,2cyclictest181rcu_preempt22:12:361
4486992915,2cyclictest181rcu_preempt22:12:361
4486992914,9cyclictest90-1pr/ttyS023:21:211
4486992914,9cyclictest90-1pr/ttyS023:21:211
4486992914,9cyclictest90-1pr/ttyS021:37:031
4486992914,9cyclictest90-1pr/ttyS021:37:031
4486992914,4cyclictest17195-21tail21:11:591
4486992914,4cyclictest17195-21tail21:11:591
4486992913,3cyclictest90-1pr/ttyS021:47:011
4486992913,3cyclictest90-1pr/ttyS021:47:011
4483992925,2cyclictest0-21swapper/020:11:440
4483992925,2cyclictest0-21swapper/020:11:440
4483992924,3cyclictest0-21swapper/022:21:450
4483992924,3cyclictest0-21swapper/022:21:450
4483992923,4cyclictest5872-21fschecks_time20:41:560
4483992923,4cyclictest171ktimers/022:27:360
4483992921,5cyclictest0-21swapper/000:01:500
4483992921,2cyclictest181rcu_preempt22:46:560
4483992921,2cyclictest181rcu_preempt22:46:560
4483992921,2cyclictest181rcu_preempt22:46:560
4483992916,4cyclictest90-1pr/ttyS022:26:060
4483992916,4cyclictest90-1pr/ttyS022:26:060
4483992914,4cyclictest90-1pr/ttyS020:51:560
4483992912,4cyclictest201rcuc/021:26:450
4483992912,4cyclictest201rcuc/021:26:450
448399291,11cyclictest174912missed_timers21:12:020
448399291,11cyclictest174912missed_timers21:12:020
138372290,2sleep30-21swapper/321:02:053
138372290,2sleep30-21swapper/321:02:053
448699286,5cyclictest281ktimers/120:55:341
4486992822,4cyclictest142-21systemd-journal19:33:051
4486992820,6cyclictest20158-21fschecks_count00:16:581
4486992820,6cyclictest20158-21fschecks_count00:16:581
4486992820,6cyclictest20158-21fschecks_count00:16:581
4486992820,6cyclictest19056-21cut22:42:041
4486992820,6cyclictest19056-21cut22:42:041
4486992820,6cyclictest19056-21cut22:42:041
4486992818,8cyclictest26648-21threads00:32:071
4486992818,8cyclictest26648-21threads00:32:071
4486992816,2cyclictest181rcu_preempt22:47:071
4486992816,2cyclictest181rcu_preempt22:47:071
4486992814,4cyclictest90-1pr/ttyS021:30:131
4486992814,4cyclictest90-1pr/ttyS021:30:131
4486992814,4cyclictest90-1pr/ttyS021:30:131
4486992814,2cyclictest181rcu_preempt00:41:571
4483992824,2cyclictest0-21swapper/023:12:080
4483992824,2cyclictest0-21swapper/000:11:530
4483992823,3cyclictest27405-21tail21:37:070
4483992823,3cyclictest27405-21tail21:37:070
4483992821,5cyclictest8087-21unixbench-2d22:12:070
4483992821,5cyclictest8087-21unixbench-2d22:12:070
4483992815,4cyclictest90-1pr/ttyS021:51:460
4483992815,4cyclictest90-1pr/ttyS021:51:460
4483992815,3cyclictest90-1pr/ttyS022:47:070
4483992815,3cyclictest90-1pr/ttyS022:47:070
4483992814,4cyclictest90-1pr/ttyS023:07:000
4483992814,4cyclictest90-1pr/ttyS023:07:000
4483992813,4cyclictest90-1pr/ttyS019:42:000
4483992813,4cyclictest90-1pr/ttyS019:42:000
448699274,5cyclictest281ktimers/119:52:021
448699274,5cyclictest281ktimers/119:52:021
4486992723,3cyclictest6117-21latency_hist23:36:451
4486992723,3cyclictest6117-21latency_hist23:36:451
4486992723,2cyclictest181rcu_preempt23:53:381
4486992723,2cyclictest181rcu_preempt23:53:381
4486992721,2cyclictest181rcu_preempt19:22:071
4486992720,5cyclictest27696-21fschecks_time23:06:571
4486992720,5cyclictest27696-21fschecks_time23:06:571
4486992715,3cyclictest17007-21kworker/u9:1-writeback20:11:551
4486992714,4cyclictest90-1pr/ttyS000:07:071
4486992714,4cyclictest90-1pr/ttyS000:07:071
4486992712,8cyclictest90-1pr/ttyS020:22:221
4486992712,8cyclictest90-1pr/ttyS020:22:221
4486992712,3cyclictest90-1pr/ttyS022:52:031
4486992712,3cyclictest90-1pr/ttyS022:52:031
4483992721,4cyclictest0-21swapper/022:01:440
4483992721,4cyclictest0-21swapper/022:01:440
4483992721,4cyclictest0-21swapper/022:01:440
4483992720,5cyclictest22930-21latency_hist20:01:480
4483992720,5cyclictest22930-21latency_hist20:01:480
4483992720,2cyclictest181rcu_preempt23:44:370
4483992720,2cyclictest181rcu_preempt23:44:370
4483992718,7cyclictest16660-21basename21:11:450
4483992718,7cyclictest16660-21basename21:11:450
4483992713,3cyclictest171ktimers/020:06:460
4483992713,3cyclictest171ktimers/020:06:460
4483992712,4cyclictest90-1pr/ttyS019:51:590
4483992712,4cyclictest90-1pr/ttyS019:51:590
4483992712,3cyclictest171ktimers/023:47:060
4483992712,3cyclictest171ktimers/023:47:060
448699267,4cyclictest0-21swapper/100:40:251
448699267,4cyclictest0-21swapper/100:40:251
448699267,4cyclictest0-21swapper/100:40:251
448699265,5cyclictest281ktimers/121:57:351
448699265,5cyclictest281ktimers/121:57:351
448699265,5cyclictest281ktimers/121:57:351
4486992622,3cyclictest9165-21sh20:51:451
4486992622,3cyclictest9165-21sh20:51:451
4486992621,4cyclictest15243-21fschecks_time21:06:551
4486992621,4cyclictest15243-21fschecks_time21:06:551
4486992610,3cyclictest0-21swapper/121:04:091
4486992610,3cyclictest0-21swapper/121:04:091
4483992619,5cyclictest12022-21cut19:31:570
4483992613,4cyclictest90-1pr/ttyS022:51:570
4483992613,4cyclictest90-1pr/ttyS022:51:570
4483992613,4cyclictest90-1pr/ttyS020:26:520
448899251,20cyclictest15570-21chrt00:01:503
448899251,20cyclictest15570-21chrt00:01:503
448899251,20cyclictest15570-21chrt00:01:503
448699258,5cyclictest281ktimers/123:22:371
448699258,5cyclictest281ktimers/123:22:371
4486992520,3cyclictest4482-21cyclictest22:02:001
4486992520,3cyclictest4482-21cyclictest22:02:001
4486992520,3cyclictest4482-21cyclictest22:02:001
4486992519,4cyclictest29766-21timerwakeupswit20:17:071
4486992519,4cyclictest29766-21timerwakeupswit20:17:071
4486992519,4cyclictest29766-21timerwakeupswit20:17:071
4483992517,2cyclictest181rcu_preempt00:09:110
4483992515,3cyclictest181rcu_preempt21:31:590
4483992515,3cyclictest181rcu_preempt21:31:590
4483992512,4cyclictest171ktimers/023:36:570
4483992512,4cyclictest171ktimers/023:36:570
11212250,3sleep10-21swapper/121:56:461
4486992416,2cyclictest181rcu_preempt23:04:041
4486992416,2cyclictest181rcu_preempt23:04:041
4486992416,2cyclictest181rcu_preempt21:45:421
4486992416,2cyclictest181rcu_preempt21:45:421
4486992416,2cyclictest181rcu_preempt21:45:421
4483992420,3cyclictest90-1pr/ttyS000:25:090
4483992420,3cyclictest90-1pr/ttyS000:25:090
4483992420,2cyclictest0-21swapper/020:22:060
4483992412,3cyclictest90-1pr/ttyS022:01:590
4483992412,3cyclictest90-1pr/ttyS022:01:590
4483992412,3cyclictest90-1pr/ttyS022:01:590
4486992316,5cyclictest13885-21cut19:36:581
4486992316,5cyclictest13885-21cut19:36:581
4486992316,5cyclictest13885-21cut19:36:581
4486992311,9cyclictest11694-21seq23:51:301
4486992311,9cyclictest11694-21seq23:51:301
4483992310,3cyclictest171ktimers/000:36:580
4483992310,3cyclictest171ktimers/000:36:580
4483992310,3cyclictest171ktimers/000:36:580
4483992310,3cyclictest171ktimers/000:36:580
448699229,9cyclictest23857-21df_inode22:56:581
448699229,9cyclictest23857-21df_inode22:56:581
4483992217,3cyclictest90-1pr/ttyS019:27:000
4487991912,6cyclictest351rcuc/221:03:342
4487991912,6cyclictest351rcuc/221:03:342
448899178,6cyclictest0-21swapper/322:52:033
448899178,6cyclictest0-21swapper/322:52:033
448799171,13cyclictest3446-21chrt22:01:572
448799171,13cyclictest3446-21chrt22:01:572
448799171,13cyclictest3446-21chrt22:01:572
448899162,10cyclictest0-21swapper/322:16:533
4488991610,4cyclictest291192sleep323:11:413
4488991610,4cyclictest291192sleep323:11:413
4488991610,4cyclictest0-21swapper/322:22:003
4488991610,4cyclictest0-21swapper/322:22:003
448799164,7cyclictest0-21swapper/200:02:002
448799164,7cyclictest0-21swapper/200:02:002
448799163,9cyclictest0-21swapper/223:18:062
448799163,9cyclictest0-21swapper/223:18:062
448799163,9cyclictest0-21swapper/220:28:052
448799163,9cyclictest0-21swapper/220:28:052
448799163,9cyclictest0-21swapper/219:44:042
448799163,9cyclictest0-21swapper/219:44:042
448799161,12cyclictest18644-21chrt19:47:072
448799161,12cyclictest18644-21chrt19:47:072
448799161,11cyclictest12073-21chrt23:51:562
448799161,11cyclictest12073-21chrt23:51:562
448799161,10cyclictest5637-21chrt20:41:542
289002161,2sleep20-21swapper/200:38:442
289002161,2sleep20-21swapper/200:38:442
289002161,2sleep20-21swapper/200:38:442
289002161,2sleep20-21swapper/200:38:442
448899159,3cyclictest0-21swapper/300:22:043
448899159,3cyclictest0-21swapper/300:22:043
448899151,7cyclictest0-21swapper/320:06:513
448899151,7cyclictest0-21swapper/320:06:513
448899151,11cyclictest20003-21chrt19:52:023
448899151,11cyclictest20003-21chrt19:52:023
448899151,11cyclictest11162-21chrt23:47:073
448899151,11cyclictest11162-21chrt23:47:073
448899151,10cyclictest568-21chrt23:21:503
448899151,10cyclictest568-21chrt23:21:503
4488991510,3cyclictest77312chrt23:38:423
4488991510,3cyclictest77312chrt23:38:423
448799159,4cyclictest121892sleep222:25:022
448799159,4cyclictest121892sleep222:25:022
448799153,9cyclictest0-21swapper/221:38:062
448799153,9cyclictest0-21swapper/221:38:062
448799152,9cyclictest22566-21chrt21:26:562
448799152,9cyclictest22566-21chrt21:26:562
448799151,9cyclictest23721-21chrt22:56:532
448799151,9cyclictest23721-21chrt22:56:532
448799151,9cyclictest0-21swapper/222:46:562
448799151,9cyclictest0-21swapper/222:46:562
448799151,9cyclictest0-21swapper/222:46:562
448799151,11cyclictest8912-21chrt20:48:332
448799151,11cyclictest8912-21chrt20:48:332
448799151,11cyclictest1228-21taskset23:22:012
448799151,11cyclictest1228-21taskset23:22:012
448799151,11cyclictest0-21swapper/223:01:582
448799151,11cyclictest0-21swapper/223:01:582
448799151,11cyclictest0-21swapper/221:16:562
448799151,11cyclictest0-21swapper/221:16:562
448799151,10cyclictest18431-21taskset00:11:542
4487991510,2cyclictest0-21swapper/223:27:082
4487991510,2cyclictest0-21swapper/223:27:082
28392150,1sleep20-21swapper/220:32:052
28392150,1sleep20-21swapper/220:32:052
253332151,2sleep30-21swapper/300:30:453
253332151,2sleep30-21swapper/300:30:453
448899149,3cyclictest40572chrt23:29:263
448899149,3cyclictest40572chrt23:29:263
448899149,3cyclictest222502chrt21:26:373
448899149,3cyclictest222502chrt21:26:373
448899149,3cyclictest20642chrt23:22:463
448899149,3cyclictest20642chrt23:22:463
448899149,3cyclictest134772chrt19:36:303
448899148,4cyclictest0-21swapper/320:12:003
448899147,4cyclictest0-21swapper/300:21:483
448899147,4cyclictest0-21swapper/300:21:483
448899147,4cyclictest0-21swapper/300:21:483
448899143,7cyclictest0-21swapper/320:51:523
448899143,7cyclictest0-21swapper/320:51:523
448899142,8cyclictest0-21swapper/319:31:473
448899141,9cyclictest7402-21chrt22:11:593
448899141,9cyclictest0-21swapper/323:43:063
448899141,9cyclictest0-21swapper/323:43:063
448899141,9cyclictest0-21swapper/323:12:053
448899141,9cyclictest0-21swapper/320:33:153
448899141,9cyclictest0-21swapper/320:33:153
448899141,9cyclictest0-21swapper/319:37:053
448899141,9cyclictest0-21swapper/319:37:053
448899141,9cyclictest0-21swapper/319:37:053
448899141,11cyclictest0-21swapper/323:06:553
448899141,11cyclictest0-21swapper/323:06:553
448899141,11cyclictest0-21swapper/321:07:053
448899141,11cyclictest0-21swapper/321:07:053
448899141,10cyclictest24498-21chrt22:57:063
448899141,10cyclictest24498-21chrt22:57:063
448899141,10cyclictest19997-21chrt21:17:083
448899141,10cyclictest19997-21chrt21:17:083
448899141,10cyclictest0-21swapper/322:41:573
448899141,10cyclictest0-21swapper/322:41:573
448899141,10cyclictest0-21swapper/322:41:573
448899141,10cyclictest0-21swapper/321:11:593
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional