You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-19 - 18:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Sun Apr 19, 2026 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2649103994839,5cyclictest438-21cron07:20:011
2649108994636,7cyclictest2673939-21idleruntime-cro08:20:012
2649108994636,6cyclictest2664981-21grep07:50:252
2649108994335,5cyclictest1-21systemd09:39:522
264910899433,11cyclictest2691309-21/usr/sbin/munin09:10:122
264910899431,10cyclictest2707623-21/usr/sbin/munin09:55:252
264910899423,8cyclictest2729387-21/usr/sbin/munin11:00:262
2649108994234,5cyclictest2680279-21unixbench_multi08:35:262
264910899421,6cyclictest2681376-21cat08:40:172
264910899421,6cyclictest2681376-21cat08:40:172
264910899421,3cyclictest0-21swapper/207:10:132
264910899421,13cyclictest2702517-21head09:40:252
2649112994129,8cyclictest2699512-21sh09:35:013
264910899411,9cyclictest2755757-21/usr/sbin/munin12:15:242
264910899411,8cyclictest2741981-21/usr/sbin/munin11:35:232
2649108994118,19cyclictest0-21swapper/207:35:162
264910899411,7cyclictest2710198-21/usr/sbin/munin10:05:262
264910899411,3cyclictest0-21swapper/207:20:122
264910899411,10cyclictest2760834-21ntpq12:30:212
264910899411,10cyclictest2684533-21/usr/sbin/munin08:50:152
264910899401,3cyclictest0-21swapper/210:40:112
264910899401,3cyclictest0-21swapper/207:55:122
264910899401,10cyclictest2744840-21df11:45:152
264910899401,10cyclictest2744840-21df11:45:142
2649103994032,5cyclictest2713377-21idleruntime-cro10:15:011
2649103994024,6cyclictest2687256-21kworker/u8:0+events_unbound10:04:581
2649112993928,7cyclictest2720398-21auditctl10:35:003
2649112993927,8cyclictest2673505-21grep08:15:243
264910899398,28cyclictest2757881-21sed12:20:242
264910899392,33cyclictest2697809-21cron09:30:012
264910899391,9cyclictest2662474-21/usr/sbin/munin07:45:202
264910899391,7cyclictest2652170-21/usr/sbin/munin07:15:222
264910899391,6cyclictest2724719-21memory10:45:202
264910899391,6cyclictest2716128-21/usr/sbin/munin10:20:222
264910899391,5cyclictest2671035-21/usr/sbin/munin08:10:172
264910899391,4cyclictest2738186-21/usr/sbin/munin11:25:172
2649108993911,25cyclictest2717236-21/usr/sbin/munin10:25:172
2649108993911,23cyclictest0-21swapper/211:05:252
264910899391,11cyclictest2747097-21memory11:50:232
264910899391,10cyclictest2675663-21basename08:25:002
2649103993932,4cyclictest2711901-21kworker/u8:1+events_unbound10:20:021
2649103993932,4cyclictest2694426-21sendmail09:20:001
264910899382,3cyclictest2718938-21apt-get10:30:132
264910899381,9cyclictest2762429-21meminfo12:35:192
264910899381,9cyclictest2689733-21cut09:05:162
264910899381,9cyclictest2688896-21users09:00:262
264910899381,6cyclictest2676957-21users08:25:262
264910899381,6cyclictest2670672-21ls08:10:012
264910899381,5cyclictest2668433-21users08:00:252
264910899381,4cyclictest2720984-21/usr/sbin/munin10:35:172
264910899381,4cyclictest2720984-21/usr/sbin/munin10:35:172
264910899381,4cyclictest2656807-21diskstats07:30:142
264910899381,3cyclictest2737188-21/usr/sbin/munin11:20:262
264910899381,12cyclictest2759467-21sed12:25:252
2649103993825,9cyclictest231ktimers/107:45:131
264910899373,6cyclictest2739716-21df11:30:152
264910899372,8cyclictest2682701-21/usr/sbin/munin08:45:262
264910899372,8cyclictest2682701-21/usr/sbin/munin08:45:252
264910899372,6cyclictest2751105-21grep12:00:262
264910899372,3cyclictest2753569-21df_inode12:10:142
264910899372,3cyclictest2728233-21ntp_states10:55:202
264910899371,8cyclictest2713400-21cat10:15:012
264910899371,8cyclictest2677742-21cut08:30:182
264910899371,7cyclictest2705130-21grep09:50:132
264910899371,7cyclictest2687118-21grep08:55:252
264910899371,5cyclictest2708660-21fschecks_count10:00:122
264910899371,3cyclictest0-21swapper/209:20:122
2649108993713,21cyclictest645-21runrttasks09:30:202
264910899371,10cyclictest2655156-21grep07:25:142
2649103993727,7cyclictest0-21swapper/110:20:011
2649112993627,6cyclictest0-21swapper/311:45:003
2649112993626,7cyclictest2693063-21fschecks_count09:15:163
2649112993625,7cyclictest0-21swapper/308:35:003
264910899362,4cyclictest2660324-21apt-get07:40:132
264910899361,5cyclictest2744054-21/usr/sbin/munin11:40:252
264910899361,4cyclictest2748449-21df_inode11:55:152
264910899361,4cyclictest2734608-21diskstats11:15:152
264910899361,3cyclictest2734229-21sshd11:14:532
264910899361,3cyclictest2714132-21/usr/sbin/munin10:15:202
264910899361,3cyclictest2703714-21/usr/sbin/munin09:45:192
264910899361,3cyclictest2703714-21/usr/sbin/munin09:45:192
264910899360,3cyclictest0-21swapper/209:15:122
2649112993525,6cyclictest0-21swapper/307:55:253
264910899355,26cyclictest2752094-21/usr/sbin/munin12:05:162
264910899351,4cyclictest2726731-21/usr/sbin/munin10:50:232
2649103993524,8cyclictest2757949-21unixbench_singl12:20:251
2649100993527,5cyclictest2722283-21kworker/u8:2+events_unbound11:15:110
2649100993525,7cyclictest2757925-21grep12:20:240
2649112993427,4cyclictest2685434-21unixbench_singl08:50:253
2649112993426,5cyclictest2757923-21unixbench_singl12:20:253
2649112993425,4cyclictest0-21swapper/311:00:153
2649103993426,4cyclictest0-21swapper/109:55:261
2649103993423,7cyclictest2661389-21grep07:40:261
2649103993422,8cyclictest2722306-21sh10:40:001
2649103993422,8cyclictest2722306-21sh10:39:591
2649100993426,5cyclictest2675661-21idleruntime-cro08:25:010
2649100993422,8cyclictest2654329-21grep07:20:250
2649112993325,4cyclictest0-21swapper/311:45:173
2649112993325,4cyclictest0-21swapper/311:45:173
2649103993324,6cyclictest2763451-21sh12:40:001
2649103993322,7cyclictest0-21swapper/107:50:251
2649112993224,5cyclictest2690989-21cron09:10:003
2649112993224,4cyclictest0-21swapper/310:50:253
2649112993222,6cyclictest0-21swapper/310:00:003
2649103993224,6cyclictest2722283-21kworker/u8:2+events_unbound11:35:131
2649103993223,6cyclictest231ktimers/112:25:131
2649103993221,8cyclictest2761292-21grep12:30:261
2649100993224,4cyclictest0-21swapper/009:04:590
2649100993224,4cyclictest0-21swapper/008:45:270
2649100993224,4cyclictest0-21swapper/008:45:270
2649100993220,8cyclictest2715207-21apt-config10:20:000
2649100993216,3cyclictest0-21swapper/010:35:010
2649112993122,5cyclictest0-21swapper/309:45:273
2649112993122,5cyclictest0-21swapper/309:45:273
2649112993122,5cyclictest0-21swapper/308:45:003
2649112993122,5cyclictest0-21swapper/308:44:593
2649112993121,6cyclictest0-21swapper/308:10:013
2649103993123,4cyclictest0-21swapper/109:45:011
2649103993121,7cyclictest2651011-21ls07:15:021
2649103993121,6cyclictest0-21swapper/108:25:261
2649100993123,5cyclictest2660008-21grep07:40:010
2649100993122,6cyclictest2742420-21kworker/u8:3+events_unbound11:55:190
2649112993024,3cyclictest0-21swapper/311:20:013
2649112993023,3cyclictest0-21swapper/311:10:263
2649103993023,4cyclictest0-21swapper/111:45:261
2649103993023,4cyclictest0-21swapper/111:45:261
2649103993021,5cyclictest0-21swapper/111:20:261
2649103993019,7cyclictest0-21swapper/109:50:241
2649103993015,12cyclictest438-21cron10:10:001
2649100993023,3cyclictest0-21swapper/012:35:270
2649112992922,5cyclictest2704466-21kworker/u8:3+events_unbound10:09:593
2649112992922,4cyclictest0-21swapper/307:25:153
2649112992921,4cyclictest0-21swapper/310:35:263
2649112992921,4cyclictest0-21swapper/310:35:263
2649112992920,6cyclictest0-21swapper/311:00:013
2649112992919,7cyclictest2650301-21grep07:10:253
2649103992923,4cyclictest2671942-21kworker/u8:1+events_unbound08:45:171
2649103992923,4cyclictest2671942-21kworker/u8:1+events_unbound08:45:171
2649103992921,4cyclictest0-21swapper/108:10:251
2649103992919,7cyclictest2749390-21grep11:55:261
2649103992919,7cyclictest2700733-21grep09:35:251
2649103992911,3cyclictest2681002-21taskset08:40:101
2649103992911,3cyclictest2681002-21taskset08:40:101
2649100992921,4cyclictest0-21swapper/008:00:010
2649100992920,6cyclictest0-21swapper/011:45:260
2649100992920,6cyclictest0-21swapper/011:45:260
2649112992820,4cyclictest0-21swapper/310:00:133
2649112992818,6cyclictest0-21swapper/312:29:593
2649103992819,5cyclictest2747646-21grep11:50:271
2649103992818,7cyclictest0-21swapper/108:50:241
2649100992821,3cyclictest0-21swapper/009:24:500
2649112992722,3cyclictest2706007-21timerwakeupswit09:50:233
2649112992720,4cyclictest0-21swapper/308:15:013
2649112992720,3cyclictest0-21swapper/308:50:003
2649112992720,3cyclictest0-21swapper/308:50:003
2649112992719,5cyclictest0-21swapper/312:10:253
2649112992717,7cyclictest2713783-21fschecks_time10:15:153
2649103992719,5cyclictest2727010-21grep10:50:251
2649103992719,5cyclictest0-21swapper/107:40:001
2649103992718,6cyclictest2754530-21grep12:10:251
264910099279,15cyclictest0-21swapper/007:15:010
2649100992720,4cyclictest0-21swapper/012:10:000
2649100992719,6cyclictest2661417-21kworker/u8:3+events_unbound07:44:380
2649100992718,6cyclictest2696360-21egrep09:25:130
2649112992620,3cyclictest0-21swapper/309:40:253
2649112992618,5cyclictest2714758-21kworker/u8:0+events_unbound10:25:483
2649112992616,5cyclictest0-21swapper/308:39:443
2649103992620,4cyclictest2674744-21kworker/u8:0+events_unbound08:34:431
2649103992620,3cyclictest0-21swapper/110:40:181
2649103992619,5cyclictest2732256-21kworker/u8:0+events_unbound12:08:211
2649103992619,5cyclictest2724247-21kworker/u8:1+events_unbound11:34:291
2649103992619,5cyclictest2581771-21kworker/u8:2+events_unbound07:31:281
2649103992613,9cyclictest2735969-21basename11:20:011
2649100992620,4cyclictest0-21swapper/008:15:250
2649100992617,6cyclictest2722324-21basename10:40:000
2649100992617,6cyclictest2722324-21basename10:40:000
2649100992617,6cyclictest121ktimers/010:20:130
2649112992517,4cyclictest0-21swapper/310:10:163
2649112992516,6cyclictest0-21swapper/312:35:263
2649112992514,7cyclictest2701238-21tr09:40:013
2649112992512,9cyclictest2651628-21cpuspeed07:15:133
264910399255,6cyclictest131rcu_preempt12:15:131
2649103992519,4cyclictest2688976-21kworker/u8:2+events_unbound09:24:511
2649103992518,5cyclictest2704466-21kworker/u8:3+events_unbound11:02:401
2649103992518,4cyclictest0-21swapper/109:30:251
2649103992518,4cyclictest0-21swapper/109:25:251
2649103992516,6cyclictest0-21swapper/110:30:171
264910399251,14cyclictest0-21swapper/111:10:141
2649100992519,3cyclictest0-21swapper/008:05:270
264910099251,8cyclictest2744035-21grep11:40:250
2649100992518,4cyclictest2741529-21fschecks_time11:35:170
2649100992517,4cyclictest0-21swapper/008:35:260
2649100992516,5cyclictest0-21swapper/011:11:440
2649100992515,6cyclictest0-21swapper/009:20:010
264910099251,4cyclictest2760618-21taskset12:30:180
264910099251,20cyclictest0-21swapper/012:25:590
2649112992418,4cyclictest2724247-21kworker/u8:1+events_unbound11:35:103
2649112992418,3cyclictest0-21swapper/307:40:013
2649112992417,5cyclictest2722283-21kworker/u8:2+events_unbound10:44:303
2649112992415,6cyclictest0-21swapper/307:45:013
264910399247,4cyclictest131rcu_preempt09:05:131
2649103992418,4cyclictest2581771-21kworker/u8:2+events_unbound07:24:001
2649103992417,5cyclictest2671942-21kworker/u8:1+events_unbound08:15:301
2649100992418,3cyclictest0-21swapper/012:10:200
2649100992418,3cyclictest0-21swapper/007:50:010
2649100992417,3cyclictest0-21swapper/012:16:430
264910099241,5cyclictest2703826-21meminfo09:45:200
264910099241,5cyclictest2703826-21meminfo09:45:190
2649100992415,6cyclictest2701377-21latency_hist09:40:010
264910099241,19cyclictest0-21swapper/011:51:040
264910099241,19cyclictest0-21swapper/011:22:110
264910099241,19cyclictest0-21swapper/008:27:340
264910099240,20cyclictest0-21swapper/011:09:250
2649112992317,3cyclictest0-21swapper/311:50:183
2649112992317,3cyclictest0-21swapper/307:20:253
2649112992316,5cyclictest2742420-21kworker/u8:3+events_unbound12:01:213
2649112992316,4cyclictest2741083-21idleruntime-cro11:35:003
2649112992316,3cyclictest0-21swapper/312:20:003
2649112992316,3cyclictest0-21swapper/307:50:003
2649112992315,5cyclictest0-21swapper/307:50:173
264911299231,12cyclictest0-21swapper/312:05:163
264910399236,10cyclictest0-21swapper/111:08:311
2649103992317,4cyclictest2665360-21kworker/u8:0+events_unbound08:00:201
2649103992315,5cyclictest0-21swapper/109:00:161
2649103992312,8cyclictest204-21dbus-daemon11:25:091
2649100992317,4cyclictest2581771-21kworker/u8:2-events_freezable_power_07:15:030
2649100992317,3cyclictest0-21swapper/012:00:200
2649100992317,2cyclictest0-21swapper/008:50:200
2649100992316,4cyclictest0-21swapper/008:30:280
2649100992316,3cyclictest0-21swapper/010:52:470
2649100992316,3cyclictest0-21swapper/009:56:160
2649100992316,3cyclictest0-21swapper/009:05:530
2649100992316,3cyclictest0-21swapper/008:41:490
2649100992316,3cyclictest0-21swapper/008:41:480
2649100992316,3cyclictest0-21swapper/008:00:070
2649100992313,7cyclictest2655498-21sed07:25:190
264910099231,20cyclictest0-21swapper/010:11:210
264910099231,20cyclictest0-21swapper/010:08:260
264910099231,18cyclictest0-21swapper/009:33:160
264910099231,18cyclictest0-21swapper/009:12:310
264910099231,18cyclictest0-21swapper/008:56:320
264910099231,18cyclictest0-21swapper/007:52:390
264910099231,18cyclictest0-21swapper/007:33:230
264910099230,19cyclictest0-21swapper/011:32:560
264910099230,19cyclictest0-21swapper/010:27:160
2649112992217,2cyclictest0-21swapper/309:25:013
2649112992216,3cyclictest0-21swapper/308:25:163
2649112992216,3cyclictest0-21swapper/308:25:013
2649112992215,4cyclictest0-21swapper/310:25:013
2649112992214,5cyclictest0-21swapper/311:05:153
2649112992212,7cyclictest2737671-21cron11:25:003
2649112992211,8cyclictest2691676-21memory09:10:183
264910399224,4cyclictest26560222sed07:25:241
2649103992216,4cyclictest2671942-21kworker/u8:1+events_unbound08:38:371
2649103992215,5cyclictest2742420-21kworker/u8:3+events_unbound11:41:481
2649103992215,5cyclictest2688976-21kworker/u8:2+events_unbound09:45:141
2649103992215,5cyclictest2688976-21kworker/u8:2+events_unbound09:45:131
2649103992214,5cyclictest0-21swapper/109:10:151
2649103992212,7cyclictest164-21systemd-journal10:56:391
2649100992217,3cyclictest0-21swapper/010:42:250
2649100992216,3cyclictest0-21swapper/009:40:230
2649100992216,2cyclictest0-21swapper/011:04:240
2649100992215,3cyclictest0-21swapper/010:49:150
264910099221,19cyclictest0-21swapper/011:28:160
264910099220,18cyclictest0-21swapper/009:51:560
264910099220,18cyclictest0-21swapper/008:11:490
264911299212,3cyclictest131rcu_preempt08:05:023
2649112992114,3cyclictest0-21swapper/312:30:173
2649112992114,3cyclictest0-21swapper/311:25:153
2649112992114,3cyclictest0-21swapper/308:55:163
264911299211,14cyclictest0-21swapper/311:55:423
264911299211,11cyclictest0-21swapper/309:03:023
264911299210,4cyclictest131rcu_preempt09:25:203
2649103992115,4cyclictest2724247-21kworker/u8:1+events_unbound10:45:251
2649103992114,4cyclictest0-21swapper/112:00:161
2649103992114,4cyclictest0-21swapper/110:25:171
2649103992114,4cyclictest0-21swapper/108:20:161
2649103992113,5cyclictest2686257-21grep08:55:161
2649103992113,5cyclictest231ktimers/108:05:151
2649112992014,3cyclictest0-21swapper/310:50:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional