You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-14 - 13:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Tue Jul 14, 2026 00:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3902357995420,14cyclictest3970503-21apt-get22:25:131
3902354995343,8cyclictest3902030-21kworker/u8:1+events_unbound19:26:440
3902354995145,4cyclictest3906120-21kworker/u8:2+events_unbound19:21:440
3902357994935,11cyclictest231ktimers/123:55:141
3902357994920,9cyclictest3930125-21/usr/sbin/munin20:25:251
3902366994834,6cyclictest3965131-21kworker/u8:1+events_unbound22:12:153
3902362994823,7cyclictest131rcu_preempt19:40:122
3902357994834,10cyclictest231ktimers/121:05:121
3902366994739,5cyclictest3969790-21unixbench_multi22:20:263
3902362994737,7cyclictest3949590-21cron21:25:012
3902362994737,7cyclictest3949590-21cron21:25:002
3902357994732,10cyclictest3927221-21basename20:20:021
3902357994720,11cyclictest3960247-21taskset21:55:051
3902357994718,10cyclictest3973076-21timerandwakeup22:30:241
3902357994713,15cyclictest3950278-21perl21:25:221
3902357994712,17cyclictest3923138-21cat20:05:271
3902357994617,9cyclictest3987466-21cat23:15:011
3902357994617,10cyclictest3908583-21irqstats19:25:191
3902357994616,12cyclictest3987718-21cut23:15:151
3902357994529,12cyclictest3902515-21apt-get19:10:101
3902357994518,9cyclictest3921687-21users20:00:271
3902357994515,10cyclictest3906127-21taskset19:18:031
3902362994436,5cyclictest3992447-21munin-plugin-st23:30:002
3902362994436,5cyclictest3992447-21munin-plugin-st23:30:002
3902357994418,8cyclictest3941745-21memory21:00:211
3902357994417,11cyclictest3924310-21if_eth020:10:161
3902357994417,10cyclictest3970483-21latency_hist22:25:001
3902362994336,4cyclictest3969801-21grep22:20:252
3902357994333,7cyclictest3934992-21/usr/sbin/munin20:40:211
3902357994330,9cyclictest3936169-21apt-get20:45:131
3902357994329,10cyclictest231ktimers/121:15:141
3902357994329,10cyclictest231ktimers/121:15:141
3902357994327,11cyclictest3962499-21/usr/sbin/munin22:00:191
3902357994319,5cyclictest4010053-21df00:20:131
3902357994319,5cyclictest4010053-21df00:20:121
3902357994317,9cyclictest3953310-21latency_hist21:35:011
3902357994231,7cyclictest231ktimers/122:45:121
3902357994219,5cyclictest3998092-21awk23:45:131
3902357994215,9cyclictest3989384-21df_inode23:20:141
3902357994214,12cyclictest4013436-21awk00:30:141
3902357994131,7cyclictest3995879-21cron23:38:011
3902357994130,7cyclictest3937867-21/usr/sbin/munin20:50:121
3902357994128,9cyclictest4005174-21/usr/sbin/munin00:05:211
3902357994127,11cyclictest3982895-21/usr/sbin/munin23:00:201
3902357994127,10cyclictest4011653-21apt-get00:25:141
3902357994126,9cyclictest0-21swapper/121:10:101
3902357994126,12cyclictest3929023-21cron20:24:001
3902357994117,9cyclictest3955496-21irqstats21:40:191
3902354994132,5cyclictest3980499-21idleruntime-cro22:55:010
3902354994117,14cyclictest131rcu_preempt19:45:020
3902366994020,13cyclictest3925241-21kworker/u8:1+events_unbound20:41:033
3902362994031,6cyclictest3990313-21unixbench_singl23:20:262
3902357994029,7cyclictest3957200-21/usr/sbin/munin21:45:191
3902357994026,11cyclictest3940348-21/usr/sbin/munin20:55:251
3902357994025,11cyclictest3907667-21cron19:21:011
3902357994013,9cyclictest3984718-21ntp_states23:05:221
3902354994031,6cyclictest3994768-21grep23:35:170
3902354994030,6cyclictest0-21swapper/019:35:000
3902366993931,4cyclictest0-21swapper/321:47:083
3902357993928,8cyclictest4015058-21/usr/sbin/munin00:35:131
3902357993926,10cyclictest3931733-21/usr/sbin/munin20:30:241
3902357993925,11cyclictest3990971-21apt-get23:25:141
3902357993925,11cyclictest3990971-21apt-get23:25:131
3902357993916,5cyclictest3964251-21ntp_states22:05:221
3902357993916,5cyclictest3964251-21ntp_states22:05:211
3902354993930,7cyclictest4000985-21kworker/u8:1+events_unbound00:17:320
3902357993828,7cyclictest3918313-21cron19:51:011
3902357993828,7cyclictest3918313-21cron19:51:011
3902357993827,8cyclictest3959761-21cron21:52:011
3902357993827,7cyclictest3981259-21/usr/sbin/munin22:55:211
3902357993827,7cyclictest3914101-21/usr/sbin/munin19:40:211
3902357993823,10cyclictest3919267-21/usr/sbin/munin19:55:201
3902357993823,10cyclictest3919267-21/usr/sbin/munin19:55:201
3902366993728,6cyclictest0-21swapper/323:00:013
3902362993729,4cyclictest0-21swapper/220:10:142
3902362993727,6cyclictest0-21swapper/221:35:012
3902362993727,6cyclictest0-21swapper/220:05:012
3902362993727,6cyclictest0-21swapper/200:10:252
3902357993728,5cyclictest0-21swapper/121:35:261
3902357993727,7cyclictest4006640-21/usr/sbin/munin00:10:141
3902357993727,7cyclictest3910276-21/usr/sbin/munin19:30:171
3902357993726,8cyclictest3997426-21cron23:41:001
3902357993726,8cyclictest3915770-21/usr/sbin/munin19:45:201
3902357993726,8cyclictest3915770-21/usr/sbin/munin19:45:201
3902357993726,7cyclictest3979270-21/usr/sbin/munin22:50:161
3902357993725,8cyclictest4008673-21/usr/sbin/munin00:15:181
3902357993724,9cyclictest3974424-21/usr/sbin/munin22:35:211
3902357993724,10cyclictest4003723-21/usr/sbin/munin00:00:241
3902357993724,10cyclictest3965974-21/usr/sbin/munin22:10:241
3902357993721,11cyclictest4000007-21/usr/sbin/munin23:50:161
3902357993720,13cyclictest3993062-21fschecks_count23:30:161
390235499376,21cyclictest4001300-21latency_hist23:55:000
3902354993728,5cyclictest0-21swapper/022:45:010
3902354993720,6cyclictest3987163-21kworker/u8:1+events_unbound23:25:230
3902354993720,6cyclictest3987163-21kworker/u8:1+events_unbound23:25:230
390236699369,7cyclictest40-21ksoftirqd/300:05:283
3902366993625,8cyclictest629-21snmpd20:25:013
3902366993625,6cyclictest391ktimers/300:35:123
3902366993616,13cyclictest4009574-21kworker/u8:2+events_unbound00:29:093
3902357993630,3cyclictest3975621-21apt-get22:40:121
3902357993626,7cyclictest3948930-21/usr/sbin/munin21:20:271
3902357993626,7cyclictest3948930-21/usr/sbin/munin21:20:271
3902357993621,10cyclictest3911955-21/usr/sbin/munin19:35:151
3902354993629,5cyclictest3915001-21kworker/u8:2+events_unbound19:51:490
3902354993629,5cyclictest3915001-21kworker/u8:2+events_unbound19:51:480
3902354993629,4cyclictest3920368-21sh20:00:010
3902354993629,4cyclictest3920368-21sh20:00:000
3902354993618,5cyclictest3925241-21kworker/u8:1+events_unbound20:41:050
3902366993528,5cyclictest3940968-21kworker/u8:2+events_unbound21:18:423
3902366993528,5cyclictest3940968-21kworker/u8:2+events_unbound21:18:413
3902366993528,5cyclictest3903790-21kworker/u8:0+events_unbound19:15:423
3902366993527,4cyclictest0-21swapper/323:15:263
3902366993522,8cyclictest391ktimers/319:40:143
3902366993515,13cyclictest3952306-21ntp_states21:30:213
3902362993527,5cyclictest0-21swapper/223:10:002
3902362993526,5cyclictest0-21swapper/223:15:002
3902362993525,6cyclictest0-21swapper/220:55:262
3902362993525,4cyclictest3902030-21kworker/u8:1+events_unbound19:16:462
3902362993524,7cyclictest0-21swapper/220:21:512
3902362993524,7cyclictest0-21swapper/219:35:262
3902357993525,7cyclictest3967369-21/usr/sbin/munin22:15:181
3902354993528,4cyclictest3951509-21idleruntime-cro21:30:010
3902354993513,6cyclictest131rcu_preempt22:20:130
3902366993428,3cyclictest3951507-21kthreadd21:30:013
3902366993427,5cyclictest3909509-21kworker/u8:2+events_unbound19:28:413
3902366993424,6cyclictest0-21swapper/323:45:013
3902366993415,10cyclictest131rcu_preempt22:37:273
3902366993411,6cyclictest131rcu_preempt23:45:123
3902362993427,4cyclictest3961313-21unixbench_singl21:55:272
3902362993424,6cyclictest0-21swapper/223:30:252
3902357993420,8cyclictest3932935-21cut20:35:151
3902354993426,5cyclictest3954910-21latency_hist21:40:000
3902354993415,6cyclictest131rcu_preempt20:05:170
3902354993413,13cyclictest11-21ksoftirqd/019:15:020
390235499341,18cyclictest0-21swapper/000:14:040
3902366993325,4cyclictest0-21swapper/320:35:153
3902362993325,4cyclictest0-21swapper/220:35:012
3902362993323,6cyclictest0-21swapper/221:40:012
3902362993319,6cyclictest3956239-21kworker/u8:1+events_unbound21:48:012
3902362993318,6cyclictest3995719-21kworker/u8:1+events_unbound23:39:482
3902354993327,3cyclictest0-21swapper/000:00:000
3902354993326,4cyclictest0-21swapper/000:30:160
3902366993225,4cyclictest0-21swapper/319:20:263
3902366993224,5cyclictest3937237-21head20:45:273
3902366993221,8cyclictest391ktimers/319:30:133
3902366993211,12cyclictest131rcu_preempt20:10:003
3902366993210,11cyclictest40-21ksoftirqd/300:00:273
3902362993225,4cyclictest0-21swapper/220:25:272
3902362993224,4cyclictest0-21swapper/220:40:252
3902362993215,10cyclictest4000985-21kworker/u8:1+events_unbound00:06:212
3902354993225,4cyclictest0-21swapper/021:10:150
3902354993224,4cyclictest0-21swapper/021:20:280
3902354993224,4cyclictest0-21swapper/021:20:270
3902354993218,5cyclictest3913032-21kworker/u8:0+events_unbound20:11:230
3902354993214,5cyclictest131rcu_preempt23:30:240
3902354993214,5cyclictest131rcu_preempt21:00:170
3902354993212,6cyclictest11-21ksoftirqd/020:25:160
3902354993210,11cyclictest0-21swapper/022:39:430
3902366993124,5cyclictest3946414-21kworker/u8:1+events_unbound21:20:163
3902366993124,5cyclictest3946414-21kworker/u8:1+events_unbound21:20:163
3902366993124,4cyclictest3983908-21sh23:05:003
3902366993123,4cyclictest0-21swapper/320:00:263
3902366993118,5cyclictest3925241-21kworker/u8:1+events_unbound20:30:463
3902366993115,5cyclictest3932360-21kworker/u8:3+events_unbound21:00:183
3902366993114,11cyclictest131rcu_preempt23:20:163
3902366993110,14cyclictest381rcuc/322:50:013
3902362993124,3cyclictest0-21swapper/219:20:272
3902362993122,5cyclictest0-21swapper/223:05:012
3902362993121,6cyclictest0-21swapper/200:20:232
3902362993121,6cyclictest0-21swapper/200:20:222
390235499319,4cyclictest0-21swapper/022:55:200
390235499318,13cyclictest131rcu_preempt00:25:220
3902354993125,4cyclictest3960027-21cron21:55:010
3902354993124,3cyclictest0-21swapper/021:20:010
3902354993124,3cyclictest0-21swapper/021:20:000
3902354993123,5cyclictest0-21swapper/023:15:010
3902354993123,5cyclictest0-21swapper/023:05:000
3902354993121,7cyclictest3940567-21grep20:55:250
3902354993116,4cyclictest131rcu_preempt19:35:180
3902354993115,5cyclictest131rcu_preempt23:40:250
3902354993111,12cyclictest131rcu_preempt00:20:130
3902354993111,12cyclictest131rcu_preempt00:20:130
3902366993021,6cyclictest0-21swapper/321:45:003
3902366993010,11cyclictest40-21ksoftirqd/320:00:013
3902366993010,11cyclictest40-21ksoftirqd/320:00:013
3902362993024,3cyclictest0-21swapper/222:50:252
3902362993023,5cyclictest3940968-21kworker/u8:2+events_unbound21:19:312
3902362993023,5cyclictest3940968-21kworker/u8:2+events_unbound21:19:312
3902362993023,4cyclictest0-21swapper/200:05:002
3902362993021,6cyclictest0-21swapper/222:25:262
3902362993020,6cyclictest0-21swapper/221:10:002
3902362993019,7cyclictest0-21swapper/223:45:252
3902362993017,5cyclictest3958251-21kworker/u8:3+events_unbound21:52:562
390235499308,14cyclictest131rcu_preempt20:20:020
3902354993024,4cyclictest3958251-21kworker/u8:3+events_unbound22:07:150
3902354993024,4cyclictest3958251-21kworker/u8:3+events_unbound22:07:150
3902354993024,3cyclictest0-21swapper/020:25:010
390235499302,13cyclictest0-21swapper/000:05:180
3902354993015,8cyclictest3963420-21kworker/u8:0+events_unbound22:25:570
3902354993013,5cyclictest3940968-21kworker/u8:2+events_unbound21:33:080
3902366992921,5cyclictest0-21swapper/322:30:013
3902366992920,7cyclictest3983791-21kworker/u8:2+events_unbound23:12:043
3902366992920,7cyclictest3958251-21kworker/u8:3+events_unbound22:04:063
3902366992920,4cyclictest0-21swapper/322:35:003
3902366992913,8cyclictest131rcu_preempt23:30:003
3902366992913,8cyclictest131rcu_preempt19:35:153
390236699291,15cyclictest0-21swapper/320:52:193
390236699291,14cyclictest0-21swapper/322:05:113
390236699291,14cyclictest0-21swapper/322:05:113
3902366992910,10cyclictest0-21swapper/321:07:233
3902362992920,6cyclictest0-21swapper/220:20:012
3902362992911,6cyclictest3959995-21kworker/u8:1+events_unbound22:02:132
390235499298,5cyclictest131rcu_preempt20:50:260
390235499296,6cyclictest11-21ksoftirqd/022:17:150
390235499294,6cyclictest3921612-21unixbench_multi20:00:260
3902354992922,4cyclictest0-21swapper/019:45:290
3902354992922,4cyclictest0-21swapper/019:45:290
390236699289,13cyclictest381rcuc/321:10:253
390236699289,11cyclictest40-21ksoftirqd/320:20:023
390236699284,4cyclictest131rcu_preempt00:30:123
3902366992822,4cyclictest3925241-21kworker/u8:1+events_unbound20:26:523
3902366992821,5cyclictest4004482-21kworker/u8:0+events_unbound00:14:423
3902366992821,4cyclictest0-21swapper/319:45:303
3902366992821,4cyclictest0-21swapper/319:45:293
3902366992812,9cyclictest131rcu_preempt23:28:293
3902366992812,9cyclictest131rcu_preempt23:28:293
3902366992812,8cyclictest131rcu_preempt22:45:003
3902362992821,3cyclictest0-21swapper/221:25:262
3902362992820,5cyclictest0-21swapper/222:40:012
3902362992819,7cyclictest3937472-21kworker/u8:0+events_unbound20:50:412
3902362992818,6cyclictest0-21swapper/222:30:262
390236299281,7cyclictest32-21ksoftirqd/200:15:112
390235499287,9cyclictest11-21ksoftirqd/020:35:170
390235499287,3cyclictest131rcu_preempt23:50:010
390235499287,13cyclictest131rcu_preempt21:40:260
3902354992821,5cyclictest4004482-21kworker/u8:0+events_unbound00:04:080
3902354992821,4cyclictest0-21swapper/000:35:120
3902354992812,5cyclictest131rcu_preempt22:00:010
3902354992811,5cyclictest131rcu_preempt23:05:150
390236699276,11cyclictest40-21ksoftirqd/319:13:053
3902366992719,4cyclictest0-21swapper/322:50:163
3902366992718,6cyclictest3994771-21fschecks_time23:35:163
3902366992717,7cyclictest3918232-21grep19:50:273
3902366992717,7cyclictest3918232-21grep19:50:273
3902366992716,8cyclictest3924576-21ntp_states20:10:203
3902366992711,9cyclictest131rcu_preempt21:35:203
390236699271,15cyclictest0-21swapper/300:15:223
390236699271,14cyclictest40-21ksoftirqd/322:00:013
3902362992720,5cyclictest3963420-21kworker/u8:0+events_unbound22:10:402
3902362992719,5cyclictest0-21swapper/200:30:252
3902362992718,5cyclictest0-21swapper/222:19:592
3902362992715,4cyclictest131rcu_preempt19:30:022
390235499279,15cyclictest11-21ksoftirqd/022:45:120
390235499276,4cyclictest131rcu_preempt23:15:160
390235499273,16cyclictest3943250-21idleruntime21:05:170
3902354992721,4cyclictest3959995-21kworker/u8:1+events_unbound22:02:150
3902354992720,5cyclictest121ktimers/020:30:130
3902354992712,3cyclictest131rcu_preempt20:45:230
390236699265,13cyclictest2790871-21kworker/3:0-events21:51:283
390236699261,15cyclictest0-21swapper/323:55:463
3902366992610,6cyclictest40-21ksoftirqd/321:00:003
3902362992619,5cyclictest3913032-21kworker/u8:0+events_unbound20:05:182
3902362992618,6cyclictest3902030-21kworker/u8:1+events_unbound19:11:442
3902362992615,8cyclictest3915344-21date19:45:022
3902362992615,8cyclictest3915344-21date19:45:022
3902362992615,4cyclictest131rcu_preempt00:00:012
3902362992614,6cyclictest3973360-21kworker/u8:0+events_unbound22:40:132
390236299260,8cyclictest0-21swapper/220:45:132
3902354992620,4cyclictest131rcu_preempt19:15:040
3902354992612,3cyclictest131rcu_preempt22:14:320
3902354992611,3cyclictest131rcu_preempt23:22:230
3902354992611,3cyclictest131rcu_preempt22:30:200
390236699257,10cyclictest40-21ksoftirqd/323:10:003
3902366992519,4cyclictest3968198-21kworker/u8:2+events_unbound22:16:233
3902366992519,3cyclictest0-21swapper/323:50:163
390236699251,4cyclictest0-21swapper/300:20:103
390236699251,4cyclictest0-21swapper/300:20:103
390236299257,11cyclictest32-21ksoftirqd/223:18:422
3902362992519,4cyclictest3944132-21kworker/u8:0+events_unbound21:11:592
3902362992519,4cyclictest3940968-21kworker/u8:2+events_unbound21:04:272
3902362992519,4cyclictest3913032-21kworker/u8:0+events_unbound19:54:542
3902362992519,4cyclictest3913032-21kworker/u8:0+events_unbound19:54:542
3902362992518,5cyclictest4014696-21kworker/u8:0+events_unbound00:39:442
3902362992516,5cyclictest0-21swapper/223:50:252
390236299251,11cyclictest0-21swapper/223:40:562
3902362992417,4cyclictest0-21swapper/200:25:272
3902362992416,5cyclictest0-21swapper/221:45:012
3902362992410,7cyclictest32-21ksoftirqd/219:55:252
3902362992410,7cyclictest32-21ksoftirqd/219:55:242
3902362992317,3cyclictest0-21swapper/219:30:142
3902362992315,6cyclictest3932360-21kworker/u8:3+events_unbound20:36:542
390236299230,12cyclictest0-21swapper/222:45:482
3902362992212,8cyclictest3981268-21ntp_kernel_pll_22:55:222
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional