You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-01 - 04:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Fri May 01, 2026 00:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3892032995237,12cyclictest231ktimers/122:00:121
3892032995237,12cyclictest231ktimers/122:00:121
3892032995041,5cyclictest3979113-21munin-plugin-st23:20:001
3892040994432,7cyclictest0-21swapper/322:19:593
389204099421,9cyclictest3922447-21/usr/sbin/munin20:35:173
389204099421,8cyclictest3976236-21/usr/sbin/munin23:10:173
3892040994212,23cyclictest0-21swapper/320:15:163
389204099421,10cyclictest3983962-21cron23:32:003
389204099411,8cyclictest3985183-21/usr/sbin/munin23:35:243
389204099411,8cyclictest3980421-21grep23:20:253
389204099411,12cyclictest3931550-21grep21:00:263
389204099411,10cyclictest3981214-21cut23:25:153
389204099410,8cyclictest3993001-21apt-get00:00:143
3892027994131,6cyclictest3909162-21taskset19:55:250
389204099408,27cyclictest3904038-21unixbench_multi19:40:263
389204099408,27cyclictest3904038-21unixbench_multi19:40:263
3892040994029,8cyclictest391ktimers/319:50:113
389204099402,5cyclictest4004983-21cron00:36:003
3892040994020,14cyclictest0-21swapper/322:05:233
3892040994020,14cyclictest0-21swapper/322:05:233
389204099401,9cyclictest3942821-21/usr/sbin/munin21:35:143
389204099401,8cyclictest3898515-21/usr/sbin/munin19:25:233
389204099401,8cyclictest3898515-21/usr/sbin/munin19:25:233
389204099401,8cyclictest3892320-21/usr/sbin/munin19:10:163
389204099401,7cyclictest3967340-21/usr/sbin/munin22:45:173
389204099401,7cyclictest3967340-21/usr/sbin/munin22:45:163
3892032994033,5cyclictest3973033-21kworker/u8:0+events_unbound00:38:061
3892027994031,6cyclictest3936889-21unixbench_multi21:15:270
389204099393,6cyclictest3925988-21ntp_states20:45:203
389204099393,3cyclictest3944406-21apt-get21:40:123
3892040993931,5cyclictest3972097-21idleruntime-cro23:00:003
3892040993931,5cyclictest3972097-21idleruntime-cro23:00:003
389204099392,6cyclictest3927576-21memory20:50:203
389204099392,6cyclictest3918532-21fschecks_count20:25:153
389204099392,4cyclictest3932359-21df_inode21:05:163
389204099392,12cyclictest3937332-21cron21:20:003
389204099391,9cyclictest3929434-21/usr/sbin/munin20:55:233
389204099391,9cyclictest3924254-21/usr/sbin/munin20:40:193
389204099391,8cyclictest3974472-21/usr/sbin/munin23:05:193
389204099391,8cyclictest3973077-21/usr/sbin/munin23:00:223
389204099391,7cyclictest3995379-21/usr/sbin/munin00:10:103
389204099391,7cyclictest3964676-21sshd22:35:463
389204099391,7cyclictest3941198-21/usr/sbin/munin21:30:163
389204099391,5cyclictest3969205-21/usr/sbin/munin22:50:163
389204099391,5cyclictest3969205-21/usr/sbin/munin22:50:163
389204099391,5cyclictest3951435-21apt-get22:00:123
389204099391,5cyclictest3951435-21apt-get22:00:123
389204099391,11cyclictest3960348-21tune2fs22:25:153
389204099391,11cyclictest3934727-21ntp_states21:10:203
389204099391,11cyclictest3934727-21ntp_states21:10:203
389204099391,10cyclictest3978081-21meminfo23:15:193
389204099391,10cyclictest3965841-21/usr/sbin/munin22:40:183
3892040993910,25cyclictest391ktimers/323:40:143
3892040993910,25cyclictest391ktimers/323:40:143
3892027993930,6cyclictest3985933-21munin-plugin-st23:40:000
3892040993829,5cyclictest391ktimers/320:30:133
389204099382,5cyclictest3908483-21irqstats19:55:183
389204099382,4cyclictest3999319-21ntp_states00:20:213
389204099382,4cyclictest3911681-21diskstats20:05:143
389204099381,9cyclictest3913604-21irqstats20:10:213
389204099381,8cyclictest3940131-21/usr/sbin/munin21:25:273
389204099381,5cyclictest3946241-21/usr/sbin/munin21:45:143
3892040993815,21cyclictest3949503-21/usr/sbin/munin21:55:223
3892040993815,19cyclictest0-21swapper/323:50:173
389204099381,4cyclictest4000543-21/usr/sbin/munin00:25:163
389204099381,4cyclictest3962320-21meminfo22:30:203
389204099381,4cyclictest3955859-21/usr/sbin/munin22:10:253
3892032993826,8cyclictest3969904-21grep22:50:241
3892032993826,8cyclictest3969904-21grep22:50:231
3892027993830,5cyclictest3923497-21sendmail20:40:010
389204099373,4cyclictest3988324-21meminfo23:45:193
389204099371,9cyclictest4002265-21/usr/sbin/munin00:30:153
389204099371,8cyclictest3991795-21/usr/sbin/munin23:55:203
389204099371,7cyclictest3910931-21/usr/sbin/munin20:00:263
389204099371,5cyclictest3917011-21if_eth120:20:173
389204099371,4cyclictest3997043-21/usr/sbin/munin00:15:133
389204099371,4cyclictest3958806-21irqstats22:20:173
389204099371,4cyclictest3947933-21/usr/sbin/munin21:50:153
389204099371,4cyclictest3896664-21meminfo19:20:193
389204099371,10cyclictest3904835-21/usr/sbin/munin19:45:143
3892032993727,7cyclictest3992308-21grep23:55:251
3892027993729,5cyclictest0-21swapper/023:24:590
3892027993728,6cyclictest0-21swapper/022:20:000
3892027993728,6cyclictest0-21swapper/019:20:000
389204099362,3cyclictest3937911-21/usr/sbin/munin21:20:173
389204099361,9cyclictest3901890-21ntp_states19:35:203
389204099361,4cyclictest3894742-21/usr/sbin/munin19:15:163
3892036993628,4cyclictest0-21swapper/222:00:002
3892036993625,7cyclictest0-21swapper/222:20:002
3892036993624,7cyclictest0-21swapper/223:00:002
3892036993624,7cyclictest0-21swapper/223:00:002
3892032993625,6cyclictest0-21swapper/123:05:181
3892027993627,6cyclictest0-21swapper/021:40:010
389204099351,4cyclictest0-21swapper/319:30:183
3892036993527,3cyclictest0-21swapper/222:40:262
3892036993526,4cyclictest0-21swapper/221:35:142
3892027993526,6cyclictest0-21swapper/022:40:000
3892027993526,5cyclictest0-21swapper/000:00:000
3892027993525,6cyclictest0-21swapper/022:00:000
3892027993524,8cyclictest3921756-21latency_hist20:35:010
3892032993427,4cyclictest3958031-21idleruntime-cro22:20:001
3892032993427,4cyclictest0-21swapper/121:15:001
3892032993427,4cyclictest0-21swapper/121:15:001
3892027993428,3cyclictest3961644-21kthreadd22:30:000
3892027993419,13cyclictest11-21ksoftirqd/019:45:130
3892036993325,5cyclictest3965074-21idleruntime-cro22:40:002
3892032993326,4cyclictest3991057-21idleruntime-cro23:55:001
3892032993325,6cyclictest3885845-21kworker/u8:1+events_unbound19:27:191
3892032993325,6cyclictest3885845-21kworker/u8:1+events_unbound19:27:181
3892032993325,4cyclictest0-21swapper/120:25:151
3892032993323,6cyclictest208-21systemd-logind21:32:361
3892032993323,6cyclictest0-21swapper/122:55:261
3892032993323,6cyclictest0-21swapper/122:55:261
3892027993325,4cyclictest0-21swapper/000:35:250
3892027993323,6cyclictest3931591-21grep21:00:270
3892027993321,7cyclictest3996317-21grep00:10:240
389204099321,12cyclictest3995100-21sh00:10:013
3892036993224,4cyclictest0-21swapper/223:55:002
3892036993224,4cyclictest0-21swapper/222:30:272
3892032993226,4cyclictest3900192-21kworker/u8:3+events_unbound19:32:201
3892032993222,6cyclictest0-21swapper/100:10:241
3892032993219,8cyclictest0-21swapper/119:15:011
3892027993224,5cyclictest0-21swapper/020:55:010
3892027993224,4cyclictest0-21swapper/022:50:250
3892027993224,4cyclictest0-21swapper/022:50:250
3892027993224,4cyclictest0-21swapper/020:05:010
3892027993223,5cyclictest0-21swapper/019:40:000
3892027993221,6cyclictest0-21swapper/021:10:240
3892027993221,6cyclictest0-21swapper/021:10:240
389202799320,4cyclictest131rcu_preempt21:30:120
3892036993123,5cyclictest3998500-21cron00:20:002
3892036993123,4cyclictest3975699-21sh23:10:002
3892036993122,5cyclictest0-21swapper/220:40:142
3892036993122,4cyclictest0-21swapper/221:30:162
3892032993126,3cyclictest3989508-21latency_hist23:50:001
3892032993124,3cyclictest0-21swapper/120:35:141
3892032993123,4cyclictest0-21swapper/123:30:001
3892032993123,4cyclictest0-21swapper/122:22:451
3892032993121,7cyclictest3938637-21grep21:20:261
3892032993120,7cyclictest0-21swapper/120:05:241
3892027993123,4cyclictest0-21swapper/022:05:000
3892027993123,4cyclictest0-21swapper/022:05:000
3892027993122,6cyclictest3974400-21fschecks_count23:05:180
3892027993122,5cyclictest0-21swapper/019:20:250
3892027993121,6cyclictest3971587-21grep22:55:260
3892027993121,6cyclictest3971587-21grep22:55:260
3892036993021,6cyclictest0-21swapper/223:15:002
3892036993021,5cyclictest208-21systemd-logind22:22:452
3892036993021,4cyclictest0-21swapper/220:05:012
3892032993021,4cyclictest0-21swapper/123:10:161
3892032993019,7cyclictest0-21swapper/121:15:281
3892032993018,7cyclictest0-21swapper/121:05:261
389203299301,24cyclictest3980341-21grep23:20:251
3892027993020,6cyclictest0-21swapper/023:30:250
3892027993020,6cyclictest0-21swapper/000:25:280
3892036992920,5cyclictest311ktimers/200:35:132
3892036992919,4cyclictest0-21swapper/220:10:282
3892036992917,8cyclictest1-21systemd23:02:512
3892032992921,4cyclictest0-21swapper/100:34:591
3892032992918,7cyclictest3964570-21grep22:35:251
389202799295,5cyclictest131rcu_preempt19:25:120
389202799295,5cyclictest131rcu_preempt19:25:120
3892027992923,4cyclictest3998535-21idleruntime-cro00:20:000
3892036992822,3cyclictest0-21swapper/222:55:002
3892036992822,3cyclictest0-21swapper/222:55:002
3892036992819,4cyclictest0-21swapper/223:40:002
3892036992819,4cyclictest0-21swapper/221:50:162
3892036992817,7cyclictest3930321-21sendmail21:00:012
3892032992821,5cyclictest3905831-21kworker/u8:2+events_unbound20:22:481
3892032992819,6cyclictest3953338-21tune2fs22:05:151
3892032992819,6cyclictest3953338-21tune2fs22:05:141
3892032992818,6cyclictest0-21swapper/123:30:251
389202799282,4cyclictest3932763-21ls21:05:210
3892027992821,4cyclictest0-21swapper/023:45:000
3892027992821,4cyclictest0-21swapper/023:45:000
3892027992821,3cyclictest0-21swapper/020:45:250
3892027992820,5cyclictest0-21swapper/019:15:020
3892027992820,4cyclictest0-21swapper/020:15:250
3892027992820,4cyclictest0-21swapper/020:05:240
3892027992820,4cyclictest0-21swapper/000:35:000
3892027992819,6cyclictest3968779-21ls22:50:000
3892027992819,6cyclictest3968779-21ls22:50:000
3892036992720,3cyclictest0-21swapper/223:40:242
3892036992720,3cyclictest0-21swapper/223:40:242
3892036992720,3cyclictest0-21swapper/220:30:232
3892032992720,4cyclictest0-21swapper/120:15:011
3892032992720,4cyclictest0-21swapper/119:50:251
3892032992717,7cyclictest3902802-21ls19:40:001
3892032992717,7cyclictest3897684-21sh19:25:011
3892027992721,4cyclictest3976381-21kworker/u8:3+events_unbound23:12:540
3892027992719,4cyclictest0-21swapper/021:30:010
3892027992719,3cyclictest0-21swapper/020:10:280
3892036992621,3cyclictest3873845-21kworker/u8:0+events_unbound19:42:212
3892036992621,3cyclictest3873845-21kworker/u8:0+events_unbound19:42:212
3892036992620,3cyclictest0-21swapper/219:25:012
3892036992619,4cyclictest0-21swapper/220:35:242
3892036992619,3cyclictest0-21swapper/220:50:262
3892036992619,3cyclictest0-21swapper/220:20:252
3892036992618,5cyclictest0-21swapper/223:55:242
3892036992617,5cyclictest3945870-21cron21:45:012
3892036992617,5cyclictest0-21swapper/223:25:152
3892032992620,4cyclictest3987408-21kworker/u8:3+events_unbound00:15:271
3892032992620,3cyclictest0-21swapper/120:40:241
3892032992619,4cyclictest0-21swapper/119:40:231
3892032992619,4cyclictest0-21swapper/119:40:231
3892032992618,5cyclictest0-21swapper/122:25:241
3892032992618,4cyclictest0-21swapper/123:05:011
3892032992618,4cyclictest0-21swapper/121:40:151
3892032992616,5cyclictest0-21swapper/122:50:001
3892032992616,5cyclictest0-21swapper/122:50:001
3892027992620,3cyclictest0-21swapper/023:25:230
3892027992619,3cyclictest0-21swapper/023:50:180
3892027992619,3cyclictest0-21swapper/020:40:140
3892027992618,5cyclictest0-21swapper/021:00:010
3892036992519,3cyclictest0-21swapper/221:10:012
3892036992518,3cyclictest0-21swapper/220:20:012
3892036992517,5cyclictest311ktimers/200:20:112
3892036992515,6cyclictest0-21swapper/221:20:002
389203299253,6cyclictest131rcu_preempt21:55:121
3892032992519,3cyclictest0-21swapper/120:55:251
3892032992518,4cyclictest0-21swapper/121:00:191
3892032992517,5cyclictest0-21swapper/123:35:261
3892032992516,6cyclictest3949457-21grep21:55:011
3892032992514,6cyclictest0-21swapper/119:20:001
3892027992518,4cyclictest0-21swapper/022:40:260
3892027992518,3cyclictest0-21swapper/000:00:200
3892027992516,7cyclictest3972632-21cstates23:00:140
3892027992515,6cyclictest3900164-21ntpq19:30:200
3892027992515,6cyclictest0-21swapper/022:22:450
389202799251,20cyclictest0-21swapper/023:46:150
3892036992418,3cyclictest0-21swapper/219:50:232
3892036992416,5cyclictest0-21swapper/200:00:172
3892036992416,4cyclictest0-21swapper/219:37:182
3892036992415,4cyclictest0-21swapper/219:30:252
3892032992416,5cyclictest3927336-21fschecks_time20:50:171
3892027992417,3cyclictest0-21swapper/023:18:300
3892027992417,3cyclictest0-21swapper/000:21:330
3892027992415,5cyclictest3907444-21grep19:50:240
389202799241,19cyclictest0-21swapper/022:30:470
389202799241,19cyclictest0-21swapper/021:21:300
3892036992317,4cyclictest3973033-21kworker/u8:0+events_unbound23:22:552
3892036992317,3cyclictest0-21swapper/219:10:242
3892036992315,4cyclictest0-21swapper/222:25:152
3892036992312,7cyclictest1-21systemd23:47:562
3892032992316,5cyclictest3996449-21kworker/u8:2+events_unbound00:20:081
3892032992316,3cyclictest0-21swapper/120:30:221
3892032992315,4cyclictest0-21swapper/121:35:151
3892032992315,4cyclictest0-21swapper/120:17:261
389202799232,3cyclictest131rcu_preempt21:45:240
3892027992316,4cyclictest13550irq/42-30be0000.ethernet20:25:010
3892027992314,5cyclictest0-21swapper/022:07:150
3892027992314,5cyclictest0-21swapper/022:07:150
389202799231,18cyclictest0-21swapper/019:42:430
389202799231,18cyclictest0-21swapper/019:42:430
389202799231,18cyclictest0-21swapper/000:06:480
389202799230,19cyclictest0-21swapper/020:27:150
3892036992216,3cyclictest0-21swapper/220:05:122
3892036992216,3cyclictest0-21swapper/219:20:002
3892036992215,4cyclictest311ktimers/221:00:132
3892036992214,4cyclictest0-21swapper/222:05:262
3892036992214,4cyclictest0-21swapper/222:05:262
3892036992212,6cyclictest3925639-21uniq20:45:162
3892032992216,3cyclictest3995106-21sh00:10:001
3892032992216,3cyclictest0-21swapper/100:00:161
389203299221,11cyclictest3908831-21find19:55:231
3892027992215,3cyclictest0-21swapper/022:11:140
3892027992215,3cyclictest0-21swapper/021:40:400
389202799221,19cyclictest0-21swapper/021:51:050
389203699212,9cyclictest3968271-21grep22:45:272
389203699212,9cyclictest3968271-21grep22:45:272
3892036992115,4cyclictest4001748-21sh00:28:002
3892036992115,3cyclictest0-21swapper/221:25:182
3892036992114,4cyclictest311ktimers/200:14:232
3892036992114,3cyclictest0-21swapper/221:50:012
3892036992113,4cyclictest0-21swapper/221:20:262
3892036992112,5cyclictest0-21swapper/220:25:242
3892036992110,7cyclictest0-21swapper/219:55:162
3892032992115,3cyclictest645-21runrttasks00:25:291
3892032992114,4cyclictest0-21swapper/121:45:141
3892032992111,7cyclictest3987053-21wc23:40:261
3892032992111,7cyclictest3987053-21wc23:40:261
3892036992013,5cyclictest311ktimers/221:10:152
3892036992013,5cyclictest311ktimers/221:10:152
3892036992011,7cyclictest311ktimers/222:00:032
3892036992011,7cyclictest311ktimers/222:00:032
3892032992014,3cyclictest3939287-21/usr/sbin/munin21:25:181
3892032992011,6cyclictest3966051-21ntpq22:40:211
389203299200,13cyclictest0-21swapper/119:48:091
3892036991912,5cyclictest311ktimers/223:15:112
3892036991912,5cyclictest311ktimers/200:30:172
3892036991912,4cyclictest3904963-21fschecks_time19:45:162
389203299191,13cyclictest3962886-21tail22:30:271
3892036991813,3cyclictest645-21runrttasks00:08:282
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional