You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-05 - 02:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Sun Jan 04, 2026 12:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
864383995842,11cyclictest391ktimers/307:55:133
864383995842,11cyclictest391ktimers/307:55:133
864372994740,4cyclictest910622-21seq09:20:250
864372994740,4cyclictest910622-21seq09:20:240
86437299462,22cyclictest871852-21latency_hist07:30:010
864381994536,4cyclictest954306-21kworker/u8:0+events_unbound11:55:382
864376994533,7cyclictest971567-21grep12:15:291
864383994436,4cyclictest950904-21apt-get11:20:003
864383994436,4cyclictest950904-21apt-get11:19:593
864376994433,7cyclictest973265-21grep12:20:241
864372994418,11cyclictest933341-21grep10:25:250
864381994337,4cyclictest948818-21kworker/u8:2+events_unbound11:15:282
864381994337,4cyclictest948818-21kworker/u8:2+events_unbound11:15:282
864381994336,4cyclictest919864-21idleruntime-cro09:50:012
864381994333,6cyclictest910855-21unixbench_multi09:20:262
864381994333,6cyclictest910855-21unixbench_multi09:20:262
864376994229,8cyclictest933358-21grep10:25:261
864383994129,7cyclictest0-21swapper/310:55:003
864381994131,6cyclictest945275-21grep11:00:272
864383994031,4cyclictest0-21swapper/309:30:303
864383994029,8cyclictest871755-21munin-plugin-st07:30:013
864381994030,6cyclictest875570-21fschecks_count07:40:162
864376994031,4cyclictest0-21swapper/110:25:011
864383993927,7cyclictest0-21swapper/312:30:273
864381993931,6cyclictest897627-21kworker/u8:1+events_unbound08:45:032
864381993921,7cyclictest131rcu_preempt07:35:132
864372993931,5cyclictest937169-21cron10:40:010
864381993832,4cyclictest958361-21kworker/u8:3+events_unbound12:00:372
864381993830,6cyclictest902416-21kworker/u8:2+events_unbound09:15:082
864381993830,6cyclictest902416-21kworker/u8:2+events_unbound09:15:082
864381993828,6cyclictest969885-21unixbench_singl12:10:242
864376993830,4cyclictest0-21swapper/111:50:011
864376993828,6cyclictest208-21systemd-logind12:10:411
864372993831,4cyclictest923303-21idleruntime-cro10:00:000
864372993812,5cyclictest11-21ksoftirqd/012:30:270
864381993729,6cyclictest975084-21kworker/u8:1+events_unbound12:30:462
864381993728,6cyclictest916037-21unixbench_singl09:35:272
864381993727,6cyclictest957440-21grep11:35:272
864381993715,5cyclictest131rcu_preempt12:05:132
864372993729,4cyclictest0-21swapper/011:05:270
864372993729,4cyclictest0-21swapper/011:05:260
864383993629,4cyclictest0-21swapper/308:20:003
864381993628,6cyclictest880056-21kworker/u8:0+events_unbound08:04:562
864381993628,6cyclictest880056-21kworker/u8:0+events_unbound08:04:552
864381993625,8cyclictest963456-21latency_hist11:55:002
864381993619,5cyclictest131rcu_preempt08:25:002
864381993617,5cyclictest131rcu_preempt10:20:012
864381993614,12cyclictest131rcu_preempt11:30:212
864381993614,11cyclictest131rcu_preempt10:45:192
864376993627,4cyclictest0-21swapper/111:50:341
864372993624,7cyclictest878116-21grep07:45:270
864383993527,4cyclictest0-21swapper/311:40:163
864383993523,8cyclictest973311-21grep12:20:263
864383993523,8cyclictest0-21swapper/307:20:013
864381993529,4cyclictest883606-21kworker/u8:2+events_unbound08:08:422
864381993520,4cyclictest131rcu_preempt08:38:072
864381993515,12cyclictest131rcu_preempt10:00:252
864381993515,12cyclictest131rcu_preempt08:35:022
864376993524,8cyclictest886710-21unixbench_singl08:10:251
864376993524,8cyclictest231ktimers/109:55:131
86437299355,11cyclictest912090-21ntpq09:25:220
864372993515,3cyclictest0-21swapper/009:55:010
864383993423,8cyclictest391ktimers/311:05:133
864383993423,8cyclictest391ktimers/311:05:133
86438199349,5cyclictest131rcu_preempt11:10:142
864381993426,4cyclictest0-21swapper/208:50:162
864381993424,4cyclictest131rcu_preempt08:11:562
864381993423,7cyclictest0-21swapper/211:40:252
864381993416,11cyclictest131rcu_preempt08:20:022
864381993413,13cyclictest131rcu_preempt10:55:192
864376993426,4cyclictest0-21swapper/112:35:171
864376993424,6cyclictest0-21swapper/109:40:011
864376993424,6cyclictest0-21swapper/108:35:001
864376993412,14cyclictest864366-21cyclictest11:18:301
864376993412,14cyclictest864366-21cyclictest11:18:301
86437299349,5cyclictest11-21ksoftirqd/011:40:000
864372993410,6cyclictest11-21ksoftirqd/007:40:000
864381993324,4cyclictest0-21swapper/212:35:162
864381993316,5cyclictest131rcu_preempt08:40:232
864381993315,11cyclictest131rcu_preempt10:35:252
864381993315,11cyclictest131rcu_preempt10:25:242
864381993314,11cyclictest131rcu_preempt09:40:262
86437699337,9cyclictest918265-21latency_hist09:45:011
864376993326,4cyclictest957905-21latency_hist11:40:011
864376993325,5cyclictest887530-21cut08:15:191
864376993325,4cyclictest0-21swapper/109:50:271
864376993324,6cyclictest954486-21cron11:30:001
864376993324,6cyclictest906160-21sh09:10:011
864376993324,5cyclictest0-21swapper/112:00:161
864376993324,5cyclictest0-21swapper/111:20:281
864376993322,9cyclictest933988-21apt-get10:30:151
86437299339,6cyclictest11-21ksoftirqd/012:35:160
86437299339,5cyclictest11-21ksoftirqd/009:15:190
86437299339,5cyclictest11-21ksoftirqd/009:15:190
86437299336,18cyclictest11-21ksoftirqd/008:40:150
864383993224,4cyclictest0-21swapper/309:20:263
864383993224,4cyclictest0-21swapper/309:20:263
864383993222,6cyclictest0-21swapper/310:15:173
864383993220,7cyclictest0-21swapper/310:00:003
86438399321,27cyclictest1-21systemd07:49:513
864381993224,4cyclictest0-21swapper/208:00:012
864381993224,4cyclictest0-21swapper/208:00:002
864381993221,4cyclictest131rcu_preempt07:45:122
864381993219,8cyclictest301rcuc/207:30:012
864381993215,5cyclictest131rcu_preempt12:15:282
864381993214,11cyclictest131rcu_preempt12:20:252
864381993214,11cyclictest131rcu_preempt09:10:012
864381993213,5cyclictest131rcu_preempt09:00:182
864381993213,12cyclictest131rcu_preempt08:55:172
864381993212,12cyclictest131rcu_preempt10:50:182
864381993212,12cyclictest131rcu_preempt07:20:262
864381993212,12cyclictest131rcu_preempt07:15:012
864381993211,13cyclictest131rcu_preempt07:50:152
864381993211,13cyclictest131rcu_preempt07:50:152
86437699329,5cyclictest24-21ksoftirqd/107:45:011
864376993221,7cyclictest964734-21grep11:55:281
864376993221,7cyclictest871307-21grep07:25:241
864376993220,8cyclictest926220-21grep10:05:261
86437299329,7cyclictest11-21ksoftirqd/009:15:000
86437299323,10cyclictest960788-21grep11:45:250
864383993124,4cyclictest0-21swapper/312:39:593
864383993122,5cyclictest928667-21apt-config10:15:023
864383993118,9cyclictest957927-21basename11:40:003
86438199318,6cyclictest131rcu_preempt10:05:152
864381993118,4cyclictest131rcu_preempt09:32:462
864381993116,5cyclictest131rcu_preempt11:45:262
864381993114,5cyclictest131rcu_preempt09:10:142
864381993112,3cyclictest131rcu_preempt09:29:112
864381993112,11cyclictest131rcu_preempt11:20:282
864381993111,12cyclictest131rcu_preempt10:20:162
864381993110,5cyclictest131rcu_preempt12:30:012
864376993122,6cyclictest923685-21grep10:00:171
864376993121,6cyclictest0-21swapper/107:45:261
86437299318,4cyclictest11-21ksoftirqd/007:15:010
864372993125,2cyclictest0-21swapper/008:30:110
864372993122,6cyclictest0-21swapper/007:30:240
864383993023,4cyclictest972021-21sendmail12:20:013
864383993022,4cyclictest0-21swapper/309:10:153
864383993020,6cyclictest0-21swapper/312:05:003
864383993019,7cyclictest0-21swapper/308:30:253
864381993017,5cyclictest131rcu_preempt10:00:022
864381993014,5cyclictest131rcu_preempt09:55:022
864381993013,4cyclictest131rcu_preempt10:42:352
864381993010,4cyclictest0-21swapper/207:15:032
864376993020,6cyclictest896922-21grep08:40:251
86437299308,6cyclictest0-21swapper/012:00:140
86437299308,5cyclictest11-21ksoftirqd/008:10:240
86437299305,7cyclictest972159-21cat12:20:010
864372993023,4cyclictest0-21swapper/010:55:210
864372993020,6cyclictest962831-21grep11:50:260
864372993012,2cyclictest0-21swapper/007:40:150
864372993010,4cyclictest11-21ksoftirqd/008:50:020
864383992921,4cyclictest0-21swapper/311:55:293
864383992921,4cyclictest0-21swapper/311:25:263
864383992921,4cyclictest0-21swapper/309:10:003
86438199294,9cyclictest32-21ksoftirqd/211:05:262
86438199294,9cyclictest32-21ksoftirqd/211:05:262
864381992923,4cyclictest891907-21kworker/u8:1+events_unbound08:29:212
864381992913,5cyclictest131rcu_preempt07:30:242
864376992923,3cyclictest0-21swapper/108:40:011
864376992919,7cyclictest912762-21cron09:27:001
864376992918,8cyclictest880522-21/usr/sbin/munin07:55:131
864376992918,8cyclictest880522-21/usr/sbin/munin07:55:131
864376992918,7cyclictest898330-21/usr/sbin/munin08:45:261
864376992913,13cyclictest0-21swapper/111:00:131
864376992913,10cyclictest53-21kcompactd009:12:381
864376992911,13cyclictest909744-21latency_hist09:20:011
864376992911,13cyclictest909744-21latency_hist09:20:001
86437299299,4cyclictest11-21ksoftirqd/010:20:220
86437299295,5cyclictest11-21ksoftirqd/012:00:010
864372992918,7cyclictest938486-21grep10:40:270
864372992918,7cyclictest919847-21cron09:50:000
864383992818,7cyclictest944442-21fschecks_time11:00:183
864383992816,8cyclictest1-21systemd10:00:153
864381992821,3cyclictest0-21swapper/210:30:202
86437699289,4cyclictest24-21ksoftirqd/110:35:131
864376992821,5cyclictest0-21swapper/112:30:001
864376992818,7cyclictest968115-21grep12:05:261
864376992818,7cyclictest937649-21perl10:40:161
864376992818,7cyclictest930148-21cron10:18:001
864376992818,6cyclictest919861-21ls09:50:001
864376992817,7cyclictest904283-21cron09:03:001
864376992816,9cyclictest913339-21/usr/sbin/munin09:30:151
864376992816,9cyclictest865278-21/usr/sbin/munin07:10:251
864376992815,10cyclictest958899-21/usr/sbin/munin11:40:211
864376992815,10cyclictest882551-21/usr/sbin/munin08:00:181
864376992815,10cyclictest882551-21/usr/sbin/munin08:00:171
86437699280,18cyclictest0-21swapper/107:38:331
86437299289,5cyclictest11-21ksoftirqd/010:02:240
86437299289,4cyclictest151rcuc/011:28:580
86437299288,8cyclictest0-21swapper/007:55:190
86437299288,8cyclictest0-21swapper/007:55:180
86437299288,6cyclictest11-21ksoftirqd/008:20:230
86437299287,11cyclictest0-21swapper/009:06:340
864372992821,3cyclictest0-21swapper/007:15:030
864372992820,4cyclictest0-21swapper/012:20:260
864372992810,8cyclictest0-21swapper/008:03:550
864372992810,8cyclictest0-21swapper/008:03:550
864383992719,4cyclictest0-21swapper/308:25:273
864383992718,5cyclictest0-21swapper/309:45:173
864383992712,9cyclictest204-21dbus-daemon09:00:053
864381992716,3cyclictest131rcu_preempt11:25:182
864376992719,5cyclictest0-21swapper/109:00:001
864376992718,7cyclictest945964-21apt-get11:05:111
864376992718,7cyclictest945964-21apt-get11:05:111
864376992717,7cyclictest975781-21df12:30:171
864376992717,7cyclictest899610-21/usr/sbin/munin08:50:131
864376992717,7cyclictest879946-21cron07:51:011
864376992717,7cyclictest879946-21cron07:51:001
864376992714,9cyclictest629-21snmpd07:15:141
864376992710,8cyclictest131rcu_preempt10:50:211
86437299275,7cyclictest927068-21fschecks_count10:10:160
86437299274,20cyclictest950893-21latency_hist11:20:000
86437299274,20cyclictest950893-21latency_hist11:19:590
864372992720,3cyclictest0-21swapper/008:40:000
864372992717,7cyclictest903147-21tune2fs09:00:160
864372992715,9cyclictest885490-21wc08:10:000
864372992715,7cyclictest869576-21grep07:20:280
864383992619,4cyclictest0-21swapper/311:10:263
864383992617,5cyclictest0-21swapper/310:35:013
86437699268,14cyclictest940587-21cron10:50:011
864376992619,4cyclictest892278-21latency_hist08:30:001
864376992616,7cyclictest943751-21cron10:57:001
864376992613,10cyclictest909962-21diskstats09:20:151
864376992613,10cyclictest909962-21diskstats09:20:151
864376992612,10cyclictest927047-21/usr/sbin/munin10:10:151
86437699260,16cyclictest0-21swapper/108:07:131
86437299269,7cyclictest131rcu_preempt08:48:520
86437299269,14cyclictest959848-21awk11:45:010
86437299267,9cyclictest11-21ksoftirqd/007:50:010
86437299267,9cyclictest11-21ksoftirqd/007:50:010
864372992614,9cyclictest968828-21apt-get12:10:110
864372992612,8cyclictest53-21kcompactd011:22:240
86437299261,14cyclictest0-21swapper/009:40:260
864383992518,4cyclictest0-21swapper/309:40:273
864383992518,3cyclictest0-21swapper/309:50:263
864383992517,5cyclictest0-21swapper/307:50:243
864383992517,5cyclictest0-21swapper/307:50:233
864383992517,4cyclictest0-21swapper/311:30:253
864383992517,4cyclictest0-21swapper/310:20:183
864383992516,5cyclictest438-21cron09:20:003
864383992516,5cyclictest438-21cron09:20:003
864383992514,7cyclictest900592-21grep08:50:263
864376992517,5cyclictest0-21swapper/111:10:261
864376992514,8cyclictest890168-21/usr/sbin/munin08:20:271
86437699251,14cyclictest0-21swapper/107:20:251
86437699251,11cyclictest0-21swapper/111:31:431
86437299256,9cyclictest131rcu_preempt08:55:240
86437299256,11cyclictest131rcu_preempt08:28:270
864372992519,3cyclictest0-21swapper/012:25:220
864372992518,4cyclictest0-21swapper/010:05:260
864372992517,5cyclictest0-21swapper/011:10:260
864372992511,9cyclictest935052-21unixbench_singl10:30:290
864383992417,3cyclictest0-21swapper/311:55:013
864383992417,3cyclictest0-21swapper/308:40:213
864383992416,3cyclictest0-21swapper/310:30:003
864383992412,8cyclictest0-21swapper/307:15:023
86437699249,10cyclictest131rcu_preempt07:30:131
86437299246,14cyclictest916456-21lockfile-create09:40:010
86437299246,11cyclictest131rcu_preempt12:05:180
86437299246,10cyclictest11-21ksoftirqd/011:31:300
864372992414,4cyclictest131rcu_preempt10:45:170
864372992413,8cyclictest204-21dbus-daemon11:00:260
86437299241,19cyclictest0-21swapper/009:32:230
864372992410,11cyclictest0-21swapper/010:50:120
864383992317,3cyclictest0-21swapper/312:25:173
864383992317,3cyclictest0-21swapper/312:05:223
864383992316,5cyclictest940408-21kworker/u8:0+events_unbound10:58:203
864383992316,5cyclictest880056-21kworker/u8:0+events_unbound08:11:213
864383992316,4cyclictest902752-21sendmail09:00:013
864383992315,4cyclictest0-21swapper/309:40:023
864383992315,4cyclictest0-21swapper/307:30:243
864383992314,6cyclictest0-21swapper/309:25:173
864383992314,6cyclictest0-21swapper/308:00:223
864383992314,6cyclictest0-21swapper/308:00:223
864383992215,3cyclictest0-21swapper/310:05:203
864383992214,5cyclictest0-21swapper/310:35:263
864383992111,7cyclictest899370-21sed08:50:013
864383992015,3cyclictest869556-21unixbench_multi07:20:283
864383992014,3cyclictest951518-21fschecks_time11:20:193
864383992014,3cyclictest0-21swapper/311:45:193
86438399192,12cyclictest969844-21tail12:10:243
864383991914,2cyclictest0-21swapper/307:35:143
864383991812,3cyclictest0-21swapper/308:20:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional