You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-11 - 05:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot5s.osadl.org (updated Thu Jun 11, 2026 00:44:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4053488994534,7cyclictest4075745-21grep20:10:263
4053479994535,5cyclictest4112803-21apt-config22:00:011
4053483994337,4cyclictest4133530-21cron23:00:002
4053488994133,5cyclictest4112661-21idleruntime-cro22:00:013
4053488994132,6cyclictest4104490-21fschecks_count21:35:143
4053479994131,7cyclictest4078276-21fschecks_count20:20:151
4053475994134,4cyclictest4098586-21grep21:20:010
4053479994029,7cyclictest0-21swapper/122:00:251
4053483993829,4cyclictest0-21swapper/223:40:012
4053479993826,9cyclictest4100034-21grep21:20:231
4053475993826,8cyclictest4114106-21grep22:00:240
4053488993727,7cyclictest4086637-21sh20:45:003
4053483993728,5cyclictest4120983-21grep22:20:242
4053483993728,5cyclictest4120983-21grep22:20:242
4053479993731,3cyclictest0-21swapper/123:45:011
4053488993628,4cyclictest4143790-21munin-run23:30:003
4053488993627,4cyclictest0-21swapper/300:00:143
4053479993627,5cyclictest4064244-21munin-plugin-st19:40:001
4053479993627,5cyclictest4064244-21munin-plugin-st19:40:001
4053475993628,4cyclictest0-21swapper/022:00:000
4053475993627,5cyclictest4138654-21sh23:15:010
4053488993525,6cyclictest0-21swapper/319:35:243
4053488993525,6cyclictest0-21swapper/319:35:233
4053488993521,6cyclictest4138271-21kworker/u8:2+events_unbound23:45:473
4053475993524,7cyclictest4093051-21grep21:00:240
4053488993424,6cyclictest4127965-21grep22:40:243
4053483993425,4cyclictest0-21swapper/220:45:162
4053483993425,4cyclictest0-21swapper/220:45:152
4053479993427,4cyclictest0-21swapper/122:15:001
4053479993427,4cyclictest0-21swapper/122:14:591
4053475993427,5cyclictest4100131-21kworker/u8:3+events_unbound21:26:190
4053475993427,4cyclictest0-21swapper/021:10:200
4053475993424,7cyclictest4157642-21idleruntime-cro00:10:000
4053475993424,6cyclictest0-21swapper/021:35:250
4053488993326,4cyclictest4157648-21cut00:10:003
4053488993325,4cyclictest0-21swapper/321:25:263
4053488993321,7cyclictest0-21swapper/322:26:313
4053483993325,4cyclictest0-21swapper/223:10:242
4053483993321,8cyclictest164-21systemd-journal20:11:072
4053475993325,5cyclictest4091752-21cut21:00:000
4053475993324,6cyclictest0-21swapper/022:25:010
4053475993324,6cyclictest0-21swapper/022:25:000
4053488993224,5cyclictest4098591-21run-parts21:20:013
4053488993224,4cyclictest0-21swapper/323:45:013
4053488993224,4cyclictest0-21swapper/323:25:013
4053488993223,5cyclictest0-21swapper/322:20:233
4053488993223,5cyclictest0-21swapper/322:20:233
405348399329,5cyclictest32-21ksoftirqd/221:20:022
4053483993225,4cyclictest0-21swapper/222:35:262
4053483993221,7cyclictest4079121-21grep20:20:232
4053483993213,6cyclictest0-21swapper/200:35:132
4053479993227,3cyclictest4145534-21kworker/u8:1+events_unbound23:36:441
4053479993224,5cyclictest4122925-21kworker/u8:0+events_unbound22:26:321
4053479993223,6cyclictest4105382-21grep21:35:251
4053479993222,6cyclictest4054634-21grep19:10:251
4053479993222,6cyclictest4054634-21grep19:10:241
4053475993224,4cyclictest0-21swapper/022:40:240
4053475993222,6cyclictest0-21swapper/023:30:230
4053475993220,9cyclictest121ktimers/020:30:100
4053475993215,14cyclictest121ktimers/023:20:010
4053488993123,4cyclictest4144363-21fschecks_count23:30:153
405348399319,6cyclictest0-21swapper/221:05:212
4053483993123,5cyclictest0-21swapper/221:30:162
4053479993125,4cyclictest4149001-21kworker/u8:1+events_unbound23:53:121
4053479993123,5cyclictest0-21swapper/100:30:231
4053479993122,6cyclictest4070598-21unixbench_multi19:55:261
4053479993121,6cyclictest0-21swapper/122:40:241
4053479993120,7cyclictest4086221-21grep20:40:271
4053475993123,5cyclictest0-21swapper/021:35:000
4053488993022,4cyclictest0-21swapper/320:05:253
4053488993021,5cyclictest0-21swapper/321:50:253
4053488993017,9cyclictest4126725-21run-parts22:40:003
405348399309,5cyclictest0-21swapper/220:15:152
405348399309,5cyclictest0-21swapper/220:15:152
405348399303,11cyclictest4115427-21ps22:05:212
4053483993022,4cyclictest0-21swapper/223:15:242
4053483993022,4cyclictest0-21swapper/221:55:152
4053483993020,6cyclictest4098170-21grep21:15:252
4053479993022,4cyclictest4167889-21idleruntime-cro00:40:011
4053479993022,4cyclictest0-21swapper/122:15:341
4053479993021,4cyclictest0-21swapper/121:15:161
4053479993021,4cyclictest0-21swapper/119:25:141
4053475993024,3cyclictest0-21swapper/021:50:010
4053475993021,5cyclictest0-21swapper/000:35:260
4053475993017,9cyclictest4064254-21tr19:40:010
4053475993017,9cyclictest4064254-21tr19:40:010
4053475993012,4cyclictest0-21swapper/022:45:230
4053475993012,4cyclictest0-21swapper/022:45:220
4053488992922,4cyclictest0-21swapper/323:55:273
4053488992921,4cyclictest0-21swapper/319:40:273
4053488992921,4cyclictest0-21swapper/319:40:273
4053488992917,8cyclictest1-21systemd21:41:223
4053488992915,6cyclictest4159295-21kworker/u8:1+events_unbound00:20:023
4053483992922,4cyclictest0-21swapper/222:50:252
4053483992921,4cyclictest0-21swapper/223:53:112
4053483992920,6cyclictest0-21swapper/221:05:012
4053483992910,7cyclictest32-21ksoftirqd/220:25:182
4053479992922,4cyclictest0-21swapper/120:10:251
4053479992920,5cyclictest0-21swapper/122:50:161
4053479992918,7cyclictest0-21swapper/120:55:251
4053475992924,3cyclictest0-21swapper/000:30:100
4053475992924,3cyclictest0-21swapper/000:25:100
4053475992920,6cyclictest4153529-21grep23:55:240
4053475992920,6cyclictest0-21swapper/022:05:240
4053475992919,7cyclictest0-21swapper/019:10:170
4053475992919,7cyclictest0-21swapper/019:10:170
4053475992919,6cyclictest0-21swapper/000:15:250
4053475992919,6cyclictest0-21swapper/000:15:250
405347599291,7cyclictest4159330-21cron00:15:000
4053488992821,4cyclictest0-21swapper/323:35:243
4053488992821,4cyclictest0-21swapper/320:30:233
4053488992820,5cyclictest4135257-21auditctl23:05:003
4053488992818,6cyclictest0-21swapper/322:04:593
4053488992817,8cyclictest4109239-21auditctl21:50:013
4053488992817,8cyclictest4057004-21grep19:15:263
4053488992817,8cyclictest4057004-21grep19:15:263
405348399288,5cyclictest32-21ksoftirqd/223:35:012
405348399288,5cyclictest32-21ksoftirqd/220:30:212
4053483992822,3cyclictest0-21swapper/222:10:252
4053483992822,3cyclictest0-21swapper/222:10:242
4053483992821,4cyclictest4150826-21munin-plugin-st23:50:002
4053483992821,4cyclictest311ktimers/200:06:522
4053483992820,4cyclictest0-21swapper/220:55:262
4053483992819,6cyclictest4159802-21grep00:15:162
4053483992819,6cyclictest4159802-21grep00:15:162
4053479992821,4cyclictest0-21swapper/123:25:151
4053479992820,4cyclictest0-21swapper/123:20:251
4053479992820,4cyclictest0-21swapper/119:55:011
4053479992819,6cyclictest4096414-21grep21:10:251
405347599282,4cyclictest4077891-21sh20:20:000
405347599282,4cyclictest4077891-21sh20:19:590
4053475992822,3cyclictest0-21swapper/021:25:010
4053475992821,3cyclictest0-21swapper/019:15:180
4053475992821,3cyclictest0-21swapper/019:15:170
4053488992720,4cyclictest0-21swapper/320:40:013
4053483992720,4cyclictest0-21swapper/222:15:342
4053483992720,3cyclictest0-21swapper/223:45:002
4053483992719,4cyclictest0-21swapper/219:15:012
4053483992719,4cyclictest0-21swapper/219:15:012
4053483992717,6cyclictest0-21swapper/223:00:252
4053483992712,4cyclictest131rcu_preempt21:46:222
4053483992710,3cyclictest131rcu_preempt00:20:532
4053479992720,4cyclictest4056960-21tail19:15:271
4053479992720,4cyclictest4056960-21tail19:15:271
4053479992719,5cyclictest0-21swapper/122:39:591
4053479992719,4cyclictest0-21swapper/123:10:011
4053479992719,4cyclictest0-21swapper/121:25:141
4053479992718,5cyclictest0-21swapper/119:20:151
4053479992717,7cyclictest4159749-21tune2fs00:15:151
4053479992717,7cyclictest4159749-21tune2fs00:15:151
4053479992716,7cyclictest4104119-21apt21:35:011
4053475992721,3cyclictest0-21swapper/020:50:250
4053475992719,5cyclictest4142547-21grep23:25:170
4053475992719,4cyclictest0-21swapper/023:40:000
4053475992717,6cyclictest0-21swapper/019:35:010
4053475992717,6cyclictest0-21swapper/019:35:000
4053475992716,7cyclictest0-21swapper/020:20:240
4053488992620,3cyclictest0-21swapper/320:45:263
4053488992620,3cyclictest0-21swapper/320:45:253
4053488992619,4cyclictest4131836-21kthreadd22:55:003
4053488992617,6cyclictest4124600-21unixbench_singl22:30:253
405348399269,9cyclictest629-21snmpd21:25:232
405348399268,3cyclictest131rcu_preempt20:52:312
405348399267,13cyclictest32-21ksoftirqd/219:35:222
405348399267,13cyclictest32-21ksoftirqd/219:35:212
405348399264,7cyclictest32-21ksoftirqd/219:25:112
4053483992620,3cyclictest0-21swapper/200:00:192
4053483992619,4cyclictest0-21swapper/220:05:252
4053483992619,4cyclictest0-21swapper/219:20:232
4053483992618,4cyclictest0-21swapper/221:40:152
4053483992617,3cyclictest131rcu_preempt19:47:312
4053483992610,6cyclictest32-21ksoftirqd/220:00:182
4053479992621,3cyclictest4086282-21kworker/u8:0+events_unbound20:51:131
4053479992620,3cyclictest0-21swapper/121:10:011
4053479992619,4cyclictest0-21swapper/119:45:261
4053479992618,4cyclictest4164460-21sh00:30:001
4053479992618,4cyclictest0-21swapper/123:45:261
4053475992621,3cyclictest4069230-21kworker/u8:0+events_unbound20:01:050
4053475992620,3cyclictest0-21swapper/023:00:250
4053475992619,4cyclictest4126723-21idleruntime-cro22:40:000
4053488992519,4cyclictest178-21systemd-udevd20:24:403
4053488992519,3cyclictest4167876-21sendmail00:40:013
4053488992519,3cyclictest4071861-21ntpq20:00:223
4053488992519,3cyclictest0-21swapper/319:25:183
4053488992518,5cyclictest178-21systemd-udevd00:12:403
4053488992516,6cyclictest0-21swapper/322:15:343
405348399259,9cyclictest131rcu_preempt20:36:032
405348399258,3cyclictest131rcu_preempt19:19:492
405348399258,3cyclictest131rcu_preempt19:19:492
4053483992517,3cyclictest131rcu_preempt21:51:372
4053483992516,6cyclictest4143301-21grep23:25:262
4053483992515,4cyclictest131rcu_preempt20:40:042
4053483992514,6cyclictest131rcu_preempt00:32:212
4053483992513,3cyclictest131rcu_preempt22:02:082
4053483992510,7cyclictest131rcu_preempt21:35:162
4053483992510,6cyclictest32-21ksoftirqd/221:10:182
4053483992510,4cyclictest32-21ksoftirqd/219:40:232
4053483992510,4cyclictest32-21ksoftirqd/219:40:222
4053479992519,3cyclictest0-21swapper/120:15:261
4053479992519,3cyclictest0-21swapper/120:15:261
4053479992518,4cyclictest0-21swapper/121:45:261
4053479992517,4cyclictest0-21swapper/119:40:241
4053479992517,4cyclictest0-21swapper/119:40:231
4053479992515,7cyclictest4110948-21seq21:55:001
4053475992519,3cyclictest0-21swapper/020:05:130
4053475992517,5cyclictest0-21swapper/020:45:150
4053475992517,5cyclictest0-21swapper/020:45:150
4053475992517,4cyclictest0-21swapper/020:30:010
4053475992516,5cyclictest0-21swapper/020:38:590
4053488992418,3cyclictest0-21swapper/322:45:123
4053488992418,3cyclictest0-21swapper/322:45:123
4053488992417,4cyclictest4088731-21fschecks_count20:50:163
4053488992417,3cyclictest0-21swapper/321:00:003
4053483992418,3cyclictest0-21swapper/223:05:152
4053483992418,3cyclictest0-21swapper/219:55:242
4053483992416,5cyclictest311ktimers/223:55:172
405348399241,5cyclictest32-21ksoftirqd/222:25:122
4053483992413,4cyclictest131rcu_preempt00:11:472
4053483992412,9cyclictest4129113-21/usr/sbin/munin22:45:192
4053483992412,9cyclictest4129113-21/usr/sbin/munin22:45:192
4053483992410,4cyclictest131rcu_preempt19:50:192
405348399240,16cyclictest0-21swapper/222:33:182
4053479992418,3cyclictest0-21swapper/100:10:231
4053479992417,4cyclictest4093464-21debian-sa121:05:011
4053479992416,5cyclictest0-21swapper/120:35:241
4053479992415,6cyclictest0-21swapper/123:15:251
4053479992414,6cyclictest0-21swapper/119:30:241
4053479992414,6cyclictest0-21swapper/119:30:241
4053475992418,3cyclictest0-21swapper/023:50:240
4053475992417,4cyclictest0-21swapper/019:50:240
4053475992416,4cyclictest0-21swapper/022:51:330
4053475992413,8cyclictest121ktimers/000:00:100
4053475992412,8cyclictest204-21dbus-daemon23:21:390
405347599241,19cyclictest0-21swapper/020:43:490
4053488992316,3cyclictest0-21swapper/322:55:183
4053488992315,5cyclictest0-21swapper/320:15:253
4053488992315,5cyclictest0-21swapper/320:15:253
4053488992315,4cyclictest0-21swapper/322:15:003
4053488992315,4cyclictest0-21swapper/322:15:003
4053488992313,7cyclictest4100507-21apt-get21:25:013
4053488992313,7cyclictest4067669-21basename19:50:013
4053488992313,7cyclictest391ktimers/323:10:103
4053488992310,4cyclictest4055097-21sh19:15:013
4053488992310,4cyclictest4055097-21sh19:15:013
405348399237,9cyclictest131rcu_preempt23:21:022
4053483992310,6cyclictest131rcu_preempt00:28:152
4053479992312,7cyclictest0-21swapper/120:25:111
405347599231,8cyclictest4162771-21idleruntime-cro00:24:590
4053475992317,3cyclictest0-21swapper/023:06:350
4053475992317,3cyclictest0-21swapper/021:50:220
4053475992316,4cyclictest0-21swapper/022:15:290
4053475992316,3cyclictest0-21swapper/019:46:030
4053475992314,6cyclictest0-21swapper/022:15:010
4053475992314,6cyclictest0-21swapper/022:15:010
4053475992312,8cyclictest4059690-21taskset19:25:170
405347599231,18cyclictest0-21swapper/022:59:480
405347599231,18cyclictest0-21swapper/019:23:320
405347599230,19cyclictest0-21swapper/021:07:530
4053488992216,3cyclictest0-21swapper/300:33:463
4053488992215,4cyclictest4057814-21fschecks_count19:20:153
4053488992215,4cyclictest0-21swapper/323:50:233
4053488992215,4cyclictest0-21swapper/300:15:253
4053488992215,4cyclictest0-21swapper/300:15:253
4053488992210,9cyclictest4093698-21apt-get21:05:123
4053488992210,8cyclictest4136967-21basename23:10:013
405348399226,12cyclictest4062128-21grep19:30:242
405348399226,12cyclictest4062128-21grep19:30:242
4053479992217,3cyclictest0-21swapper/123:55:181
4053479992216,3cyclictest0-21swapper/122:45:241
4053479992216,3cyclictest0-21swapper/122:45:241
4053479992216,3cyclictest0-21swapper/122:30:151
4053479992216,3cyclictest0-21swapper/122:20:231
4053479992216,3cyclictest0-21swapper/122:20:231
4053475992217,3cyclictest13850irq/36-mmc119:40:370
4053475992217,3cyclictest13850irq/36-mmc119:40:370
4053475992216,3cyclictest0-21swapper/023:40:150
405347599221,3cyclictest0-21swapper/021:41:050
4053475992213,6cyclictest4075744-21grep20:10:260
4053488992115,4cyclictest164-21systemd-journal21:02:403
4053488992115,3cyclictest0-21swapper/319:30:223
4053488992115,3cyclictest0-21swapper/319:30:213
4053488992113,5cyclictest4068455-21ntpq19:50:203
4053488992112,6cyclictest4096449-21sed21:10:253
4053488992112,6cyclictest0-21swapper/320:25:153
4053488992111,6cyclictest0-21swapper/300:29:593
4053479992116,3cyclictest4161439-21fschecks_count00:20:141
4053479992116,2cyclictest0-21swapper/123:10:221
4053479992115,3cyclictest0-21swapper/121:40:201
4053479992115,3cyclictest0-21swapper/100:05:181
4053479992114,5cyclictest231ktimers/120:00:141
4053479992114,4cyclictest0-21swapper/120:05:241
4053479992112,6cyclictest0-21swapper/120:45:211
4053479992112,6cyclictest0-21swapper/120:45:211
4053475992114,4cyclictest4150406-21grep23:45:260
4053488992014,3cyclictest0-21swapper/321:30:153
4053488992013,4cyclictest4070319-21mailstats19:55:233
4053488992012,5cyclictest4115804-21unixbench_multi22:05:243
4053488992010,6cyclictest0-21swapper/323:15:253
405347999209,7cyclictest0-21swapper/122:55:241
405347999205,10cyclictest4155501-21grep00:00:251
4053479992014,3cyclictest0-21swapper/122:10:011
4053479992011,6cyclictest0-21swapper/123:00:121
4053479991911,5cyclictest0-21swapper/120:30:131
4053479991910,6cyclictest4145810-21cut23:35:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional