You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-02 - 15:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Thu Jul 02, 2026 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2619772996033,22cyclictest0-21swapper/011:50:000
261977299543,13cyclictest13550irq/42-30be0000.ethernet10:40:110
2619785995241,7cyclictest2695783-21grep10:45:253
2619776995040,6cyclictest204-21dbus-daemon08:30:241
2619785994941,5cyclictest2713483-21idleruntime-cro11:40:003
2619772994937,7cyclictest2637585-21sendmail08:00:010
2619781994840,5cyclictest2596314-21kworker/u8:0+events_unbound07:15:022
2619776994615,27cyclictest2696111-21seq10:48:551
2619772994517,23cyclictest0-21swapper/011:25:140
2619785994433,7cyclictest2649060-21grep08:30:243
2619776994437,4cyclictest2654633-21latency_hist08:49:591
261977299449,4cyclictest26414712sleep008:10:160
2619772994435,5cyclictest2727112-21cron12:20:000
2619781994328,11cyclictest438-21cron08:45:002
2619772994335,5cyclictest2630759-21sendmail07:40:010
2619772994335,5cyclictest2630759-21sendmail07:40:000
2619772994312,4cyclictest0-21swapper/010:20:010
2619772994312,3cyclictest2681042-21fschecks_count10:05:160
261977299431,19cyclictest2671949-21chrt09:38:090
2619781994235,5cyclictest2635761-21kworker/u8:1+events_unbound08:10:202
2619781994229,8cyclictest0-21swapper/209:00:282
261977699422,11cyclictest2729058-21/usr/sbin/munin12:25:221
2619776994214,23cyclictest199-21systemd-network09:50:051
2619776994214,23cyclictest199-21systemd-network09:50:051
261977699421,10cyclictest2682789-21/usr/sbin/munin10:10:171
261977299421,4cyclictest2725418-21awk12:15:000
2619785994130,8cyclictest0-21swapper/309:20:003
261977699413,10cyclictest2636548-21memory07:55:181
261977699411,8cyclictest2687916-21/usr/sbin/munin10:25:231
2619776994115,22cyclictest0-21swapper/108:55:231
261977699411,11cyclictest2699855-21basename11:00:011
2619772994121,15cyclictest0-21swapper/008:20:010
2619772994114,3cyclictest2624327-21fschecks_count07:20:160
2619772994112,3cyclictest0-21swapper/010:55:010
2619781994032,4cyclictest2644398-21sendmail08:20:002
2619781994030,7cyclictest2640987-21munin-plugin-st08:10:012
261977699401,9cyclictest2646093-21cron08:25:001
261977699401,10cyclictest438-21cron12:10:001
261977699401,10cyclictest2701124-21grep11:00:241
2619772994033,3cyclictest0-21swapper/012:40:000
261977299402,12cyclictest2623699-21cron07:20:010
261977299402,10cyclictest2699814-21cron11:00:010
261977299402,10cyclictest2649924-21fschecks_time08:35:170
261977299402,10cyclictest2649924-21fschecks_time08:35:170
2619772994013,3cyclictest0-21swapper/011:15:010
261977299401,16cyclictest2664817-21unixbench_multi09:15:250
261977299401,12cyclictest2728855-21wc12:25:010
261977299401,12cyclictest2719225-21cat11:55:190
2619772994010,7cyclictest2670516-21sed09:35:010
2619772994010,4cyclictest0-21swapper/011:34:590
2619785993930,5cyclictest2706653-21idleruntime-cro11:20:013
2619781993928,8cyclictest2625177-21grep07:20:252
261977699395,7cyclictest2704137-21/usr/sbin/munin11:10:231
261977699392,5cyclictest2678922-21cron10:00:001
261977699392,5cyclictest2675519-21cron09:50:001
2619776993911,3cyclictest0-21swapper/110:50:251
2619776993911,25cyclictest0-21swapper/110:15:241
261977699391,10cyclictest2650284-21tr08:35:221
261977699391,10cyclictest2650284-21tr08:35:221
261977299391,4cyclictest2720644-21df12:00:130
261977299391,4cyclictest2720644-21df12:00:130
261977299391,12cyclictest2632045-21sed07:40:260
261977699389,2cyclictest0-21swapper/108:50:241
261977699389,2cyclictest0-21swapper/108:50:241
261977699387,5cyclictest0-21swapper/108:02:231
2619776993826,8cyclictest2711292-21grep11:30:251
261977699382,10cyclictest2731901-21sshd12:31:081
261977699381,9cyclictest2707107-21fschecks_time11:20:151
261977699381,9cyclictest2652142-21find08:40:221
261977699381,9cyclictest2627710-21fschecks_count07:30:151
261977699381,7cyclictest2718109-21grep11:50:251
261977699381,11cyclictest2712687-21wc11:35:241
261977699381,11cyclictest2690614-21unixbench_multi10:30:251
261977699381,10cyclictest2713919-21grep11:40:151
261977699381,10cyclictest2666063-21/usr/sbin/munin09:20:191
261977699380,11cyclictest2720982-21meminfo12:00:181
261977699380,11cyclictest2720982-21meminfo12:00:181
2619772993828,6cyclictest0-21swapper/009:00:280
261977299382,12cyclictest2629030-21cron07:35:010
261977299381,5cyclictest2666665-21runrttasks09:21:000
261977299381,4cyclictest2638152-21irqstats08:00:180
2619772993813,5cyclictest13550irq/42-30be0000.ethernet09:10:110
261977299381,15cyclictest2700287-21fschecks_time11:00:150
2619785993725,8cyclictest2708364-21auditctl11:25:013
261977699378,5cyclictest0-21swapper/109:42:101
261977699374,6cyclictest2686352-21/usr/sbin/munin10:20:151
2619776993727,7cyclictest2635874-21munin-plugin-st07:55:011
2619776993726,7cyclictest0-21swapper/107:15:261
261977699372,5cyclictest2671670-21head09:35:261
2619776993723,10cyclictest1-21systemd08:25:221
261977699372,10cyclictest2725632-21/usr/sbin/munin12:15:171
261977699371,9cyclictest2670003-21head09:30:261
261977699371,8cyclictest2629438-21fschecks_count07:35:151
261977699371,8cyclictest2629438-21fschecks_count07:35:151
261977699371,7cyclictest2639670-21fschecks_count08:05:151
261977699371,6cyclictest2631982-21grep07:40:261
261977699371,5cyclictest2644378-21cron08:20:011
261977699371,11cyclictest2727479-21diskstats12:20:151
261977699371,11cyclictest2705707-21tr11:15:191
261977699371,11cyclictest2663180-21sed09:10:271
261977699371,10cyclictest2719266-21meminfo11:55:201
261977699371,10cyclictest2715515-21/usr/sbin/munin11:45:131
261977699371,10cyclictest2619932-21apt-get07:10:111
2619772993729,4cyclictest0-21swapper/010:15:010
2619772993713,5cyclictest121ktimers/012:05:150
2619772993713,3cyclictest2635409-21unixbench_multi07:50:250
2619781993624,8cyclictest2637118-21grep07:55:242
261977699364,6cyclictest2733510-21unixbench_singl12:35:261
261977699362,6cyclictest2724922-21grep12:10:231
261977699361,8cyclictest2664299-21missed_timers09:15:201
261977699361,11cyclictest2692783-21cron10:40:001
261977699361,11cyclictest2667693-21missed_timers09:25:211
2619772993627,6cyclictest2675118-21grep09:45:270
2619772993627,5cyclictest2713058-21unixbench_singl11:35:270
261977299362,13cyclictest2654621-21cron08:50:000
2619772993612,5cyclictest121ktimers/008:40:180
2619785993524,8cyclictest2714708-21grep11:40:243
261978199358,5cyclictest131rcu_preempt07:35:112
261978199358,5cyclictest131rcu_preempt07:35:112
2619781993529,4cyclictest2690341-21kworker/u8:2+events_unbound10:35:452
2619781993528,4cyclictest2654229-21unixbench_singl08:45:262
2619781993526,5cyclictest645-21runrttasks09:40:322
261977699358,3cyclictest2701824-21cpuspeed11:05:121
261977699351,9cyclictest2624269-21cstates07:20:141
261977699351,7cyclictest2660164-21cron09:05:011
261977699351,5cyclictest2710059-21cron11:30:001
2619772993524,8cyclictest2680657-21idleruntime-cro10:04:590
2619772993514,3cyclictest2646518-21fschecks_time08:25:170
2619772993513,3cyclictest645-21runrttasks07:30:010
2619772993513,3cyclictest0-21swapper/010:48:260
261977299351,11cyclictest2658248-21munin-run09:00:000
2619785993427,4cyclictest2730535-21kthreadd12:30:013
2619785993424,7cyclictest2637570-21cut08:00:013
2619781993428,3cyclictest2665288-21kthreadd09:20:012
2619781993425,6cyclictest2673548-21kworker/u8:0+events_unbound09:50:322
2619781993425,6cyclictest2673548-21kworker/u8:0+events_unbound09:50:312
261977699349,4cyclictest231ktimers/110:05:181
261977699341,8cyclictest2634154-21sh07:50:001
2619785993324,6cyclictest2720308-21sendmail12:00:003
2619785993324,5cyclictest0-21swapper/310:55:173
2619781993326,4cyclictest0-21swapper/207:20:012
2619781993325,4cyclictest0-21swapper/212:30:012
2619781993322,7cyclictest0-21swapper/211:05:252
261977299339,6cyclictest2645080-21load08:20:190
261977299337,7cyclictest2729245-21grep12:25:160
2619772993324,5cyclictest0-21swapper/010:25:250
2619772993323,6cyclictest0-21swapper/010:20:250
2619785993224,4cyclictest0-21swapper/310:25:403
2619785993224,4cyclictest0-21swapper/308:35:273
2619785993224,4cyclictest0-21swapper/308:35:273
2619785993222,6cyclictest2658272-21kthreadd09:00:003
261977699329,4cyclictest231ktimers/110:40:221
261977699321,13cyclictest2626568-21wc07:25:241
2619781993124,4cyclictest0-21swapper/211:50:252
2619781993123,5cyclictest2711775-21munin-plugin-st11:35:002
2619781993123,4cyclictest0-21swapper/210:45:162
261977299311,11cyclictest2621401-21apt07:15:010
2619785993022,4cyclictest0-21swapper/309:35:263
2619785993021,5cyclictest0-21swapper/312:40:003
2619781993023,4cyclictest0-21swapper/212:30:242
2619781993021,4cyclictest0-21swapper/208:30:252
2619781993013,13cyclictest301rcuc/209:05:242
261978199300,4cyclictest131rcu_preempt12:15:092
2619781992923,4cyclictest2675279-21kworker/u8:1+events_unbound09:55:352
2619781992922,3cyclictest0-21swapper/210:25:252
2619781992921,4cyclictest0-21swapper/209:40:012
2619781992920,6cyclictest0-21swapper/209:25:252
2619781992917,8cyclictest1-21systemd11:46:002
261977699299,4cyclictest231ktimers/109:09:571
2619776992921,4cyclictest0-21swapper/108:10:141
2619772992921,4cyclictest0-21swapper/012:30:240
2619785992819,6cyclictest0-21swapper/307:40:263
2619785992819,5cyclictest0-21swapper/311:45:253
2619785992816,8cyclictest204-21dbus-daemon12:11:053
2619781992820,5cyclictest0-21swapper/211:55:272
2619781992820,5cyclictest0-21swapper/208:40:002
2619781992820,5cyclictest0-21swapper/208:39:592
2619781992820,4cyclictest2647801-21sh08:30:002
2619781992820,4cyclictest0-21swapper/209:30:272
2619781992820,4cyclictest0-21swapper/207:25:262
2619781992815,6cyclictest2630508-21kworker/u8:0+events_unbound07:45:512
261978199281,4cyclictest131rcu_preempt07:30:122
2619776992820,4cyclictest0-21swapper/110:05:001
2619772992811,3cyclictest0-21swapper/009:28:120
2619785992715,9cyclictest2692361-21unixbench_singl10:35:253
2619781992720,5cyclictest2630508-21kworker/u8:0+events_unbound07:40:102
2619781992720,4cyclictest0-21swapper/210:55:262
2619781992719,4cyclictest0-21swapper/209:45:272
2619781992718,6cyclictest2700906-21grep11:00:232
2619781992717,6cyclictest0-21swapper/212:05:002
2619781992717,6cyclictest0-21swapper/212:04:592
2619772992718,7cyclictest121ktimers/011:40:110
2619772992715,7cyclictest0-21swapper/011:55:000
2619785992619,3cyclictest0-21swapper/309:40:153
2619785992618,5cyclictest2630508-21kworker/u8:0+events_unbound07:50:013
2619785992618,4cyclictest0-21swapper/312:20:143
2619785992616,6cyclictest2678448-21tail09:55:263
261978599261,5cyclictest131rcu_preempt10:00:093
2619785992615,7cyclictest2630286-21grep07:35:253
2619785992615,7cyclictest2630286-21grep07:35:243
261978599261,4cyclictest2635404-21unixbench_multi07:50:253
261978199263,5cyclictest131rcu_preempt11:20:122
2619781992620,4cyclictest2630508-21kworker/u8:0+events_unbound08:03:432
2619781992619,4cyclictest0-21swapper/210:05:162
2619781992619,3cyclictest0-21swapper/210:50:242
2619781992618,4cyclictest2684705-21fschecks_time10:15:152
261977299262,20cyclictest2661389-21tail09:05:240
2619772992612,4cyclictest0-21swapper/011:23:140
261978599254,3cyclictest131rcu_preempt12:05:113
2619785992518,5cyclictest2621192-21kworker/u8:2+events_unbound07:20:003
2619785992518,4cyclictest2644795-21fschecks_count08:20:163
2619785992517,4cyclictest0-21swapper/310:30:143
2619781992519,3cyclictest0-21swapper/211:40:232
2619781992517,5cyclictest629-21snmpd10:23:192
2619781992517,5cyclictest0-21swapper/212:10:162
2619781992515,7cyclictest2727924-21ntp_states12:20:212
2619772992520,3cyclictest13550irq/42-30be0000.ethernet07:45:140
2619772992515,7cyclictest438-21cron10:00:000
2619772992515,7cyclictest2691848-21ntpq10:35:200
261977299251,21cyclictest2649118-21users08:30:250
2619785992418,4cyclictest2703009-21kworker/u8:0+events_unbound11:09:053
2619785992416,4cyclictest0-21swapper/309:35:003
2619785992416,4cyclictest0-21swapper/307:15:013
2619785992415,6cyclictest2696600-21fschecks_count10:50:173
2619785992415,6cyclictest0-21swapper/311:25:233
2619785992414,6cyclictest0-21swapper/309:50:153
2619785992414,6cyclictest0-21swapper/309:50:153
2619781992418,4cyclictest2703009-21kworker/u8:0+events_unbound11:10:082
2619781992418,4cyclictest2690341-21kworker/u8:2+events_unbound10:33:562
2619781992418,4cyclictest2661494-21kworker/u8:1+events_unbound09:12:392
2619781992418,4cyclictest2644326-21kworker/u8:1+events_unbound08:50:282
2619781992418,4cyclictest2644326-21kworker/u8:1+events_unbound08:50:282
2619781992418,3cyclictest0-21swapper/212:05:252
2619781992418,3cyclictest0-21swapper/211:35:142
2619781992417,4cyclictest0-21swapper/208:20:262
2619781992413,8cyclictest204-21dbus-daemon08:55:272
2619772992420,2cyclictest13550irq/42-30be0000.ethernet09:40:200
2619785992316,4cyclictest0-21swapper/310:15:013
2619785992316,4cyclictest0-21swapper/308:15:173
2619785992316,3cyclictest0-21swapper/308:45:253
2619785992315,5cyclictest2642684-21sh08:15:013
2619781992317,4cyclictest2731986-21kworker/u8:2+events_unbound12:35:202
2619781992316,5cyclictest2630508-21kworker/u8:0+events_unbound07:50:172
2619772992316,4cyclictest0-21swapper/008:05:250
261977299231,19cyclictest0-21swapper/011:18:290
261977299230,19cyclictest0-21swapper/008:52:570
261977299230,19cyclictest0-21swapper/008:52:560
261978599228,4cyclictest131rcu_preempt07:20:143
261978599221,6cyclictest2726637-21grep12:15:223
2619785992216,3cyclictest0-21swapper/307:30:243
2619785992214,6cyclictest391ktimers/307:30:013
2619785992214,5cyclictest0-21swapper/311:30:253
2619785992214,4cyclictest0-21swapper/310:20:013
2619785992213,6cyclictest391ktimers/309:00:243
2619785992213,6cyclictest2651838-21ls08:40:193
2619785992212,7cyclictest2720780-21basename12:00:163
2619785992212,7cyclictest2720780-21basename12:00:153
2619781992215,4cyclictest0-21swapper/210:10:242
2619772992215,4cyclictest0-21swapper/010:35:000
2619785992115,3cyclictest0-21swapper/311:50:153
2619785992115,3cyclictest0-21swapper/309:50:013
2619785992115,3cyclictest0-21swapper/308:05:193
2619785992114,4cyclictest0-21swapper/310:05:213
2619785992113,5cyclictest391ktimers/311:10:173
2619785992113,5cyclictest391ktimers/311:00:223
2619785992113,5cyclictest391ktimers/309:25:253
2619785992113,5cyclictest2652681-21kworker/u8:2+events_unbound09:10:173
2619785992113,5cyclictest0-21swapper/308:00:283
2619781992115,4cyclictest2709915-21kworker/u8:0+events_unbound11:28:372
2619781992114,5cyclictest2678741-21kworker/u8:0+events_unbound10:01:412
2619781992112,5cyclictest311ktimers/209:20:242
2619785992014,3cyclictest2693255-21fschecks_time10:40:163
2619785992013,5cyclictest2686568-21uname10:20:183
2619785992012,5cyclictest2655235-21fschecks_count08:50:163
2619785992012,5cyclictest2655235-21fschecks_count08:50:163
2619772992015,3cyclictest13550irq/42-30be0000.ethernet09:50:120
2619772992015,3cyclictest13550irq/42-30be0000.ethernet09:50:120
261978599197,4cyclictest0-21swapper/308:26:493
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional