You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-30 - 20:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack2slot7s.osadl.org (updated Sun Nov 30, 2025 12:39:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2616281995546,5cyclictest0-21swapper/210:49:222
2616279995445,6cyclictest1780552-21cups-browsed09:13:240
2616281995338,9cyclictest422-21dbus-daemon11:59:252
2616280995344,6cyclictest2652296-21latency_hist09:10:021
2616280995233,7cyclictest956-21mta-sts-daemon09:39:211
2616280995142,6cyclictest422-21dbus-daemon10:40:011
2616280995139,8cyclictest1780552-21cups-browsed10:54:231
2616281995018,11cyclictest2735340-21ntpq11:14:292
2616279995037,5cyclictest422-21dbus-daemon10:00:020
2616279994938,8cyclictest2634280-21systemd-run08:10:020
261628099484,37cyclictest2689357-21ssh10:04:251
2616279994836,5cyclictest151ktimers/010:14:240
2616281994722,9cyclictest2653531-21sh09:12:082
2616281994712,30cyclictest2709676-21ssh10:34:172
2616279994739,5cyclictest2692304-21cpuspeed10:09:100
2616280994637,5cyclictest2652252-21diskmemload09:29:051
2616280994537,5cyclictest2739427-21systemd-run11:20:021
2616279994533,9cyclictest2742591-21cron11:25:010
2616279994533,9cyclictest2742591-21cron11:25:010
2616281994435,6cyclictest422-21dbus-daemon11:09:382
2616281994416,11cyclictest2782387-21ssh12:20:352
2616279994435,6cyclictest12450irq/32-eth011:44:370
2616279994424,7cyclictest2652252-21diskmemload11:39:210
2616281994334,6cyclictest1-21systemd09:30:012
2616281994333,6cyclictest2686585-21munin-run10:00:012
2616281994329,8cyclictest2633630-21ntpq08:09:152
2616281994319,7cyclictest2693002-21ps10:09:262
2616281994318,17cyclictest0-21swapper/207:59:202
2616280994335,5cyclictest2780306-21aten_r2power_fr12:19:071
2616279994329,7cyclictest151ktimers/007:54:390
2616281994233,6cyclictest2698902-21aten_r2power_cu10:19:052
2616281994233,6cyclictest2698902-21aten_r2power_cu10:19:052
2616281994233,4cyclictest0-21swapper/209:24:172
2616281994222,5cyclictest2645658-21ntpq08:49:172
2616281994222,13cyclictest2641129-21ntpq08:34:152
2616281994218,7cyclictest2773446-21ntpq12:09:182
2616280994234,5cyclictest2617766-21cut07:15:001
261628199415,28cyclictest2777143-21ssh12:14:192
2616281994128,8cyclictest2635262-21ntpq08:14:222
2616281994120,5cyclictest2720731-21sh10:50:442
2616281994118,7cyclictest2779873-21sh12:18:222
2616281994115,8cyclictest2711632-21ssh10:37:132
2616280994133,5cyclictest2632922-21latency_hist08:05:031
2616279994130,8cyclictest2672448-21sshd09:39:400
2616279994128,8cyclictest2652252-21diskmemload11:49:200
2616279994128,8cyclictest2652252-21diskmemload11:49:200
261627999412,30cyclictest2781072-21ssh12:19:220
2616281994032,4cyclictest2690130-21kworker/u8:9+xprtiod10:05:022
2616281994030,6cyclictest2652252-21diskmemload11:27:072
2616281994030,6cyclictest2652252-21diskmemload11:27:072
2616281994028,8cyclictest2624653-21ntpq07:39:182
2616281994026,9cyclictest2648613-21ntpq08:59:162
2616281994026,10cyclictest2750802-21sh11:38:342
2616281994019,7cyclictest2789725-21ssh12:30:452
2616281994015,9cyclictest2701692-21ssh10:22:382
2616280994033,4cyclictest0-21swapper/112:05:011
2616280994030,7cyclictest2763256-21cron11:55:001
2616280994030,7cyclictest2763256-21cron11:55:001
2616279994032,5cyclictest421-21avahi-daemon12:39:100
2616279994028,5cyclictest2669093-21debian-sa109:35:010
2616281993931,4cyclictest0-21swapper/209:10:012
2616281993927,7cyclictest2650253-21ntpq09:04:212
2616281993926,9cyclictest2676635-21sh09:45:402
2616281993925,8cyclictest2621686-21ntpq07:29:182
2616281993925,10cyclictest2695120-21sh10:13:122
2616281993924,12cyclictest2626276-21ntpq07:44:242
2616281993924,12cyclictest2626276-21ntpq07:44:242
2616281993924,11cyclictest2795761-21ntpq12:39:212
2616281993924,11cyclictest2740425-21ssh11:22:262
2616281993924,11cyclictest2740425-21ssh11:22:262
2616281993924,11cyclictest2618689-21ntpq07:19:202
2616281993923,11cyclictest2646778-21fschecks_count08:54:092
2616281993919,14cyclictest2756192-21ssh11:45:112
2616281993919,14cyclictest2756192-21ssh11:45:112
2616281993915,8cyclictest2642102-21aten2.4-expect08:39:072
261628099393,27cyclictest2758665-21ssh11:49:181
261628099393,27cyclictest2758665-21ssh11:49:181
261628099391,30cyclictest2709756-21ssh10:34:201
2616279993930,6cyclictest2749386-21cron11:35:000
2616279993927,9cyclictest2703148-21gcc10:24:270
2616279993927,8cyclictest2726276-21switchtime10:59:290
2616281993826,9cyclictest2669976-21sh09:36:352
2616281993826,8cyclictest2644228-21ntpq08:44:212
2616281993826,8cyclictest2639761-21ntpq08:29:232
2616281993826,8cyclictest2622511-21munin-node07:34:052
2616281993826,7cyclictest2725972-21ntpq10:59:202
2616281993826,7cyclictest2620148-21ntpq07:24:192
2616281993825,7cyclictest2675366-21ntpq09:44:212
2616281993825,10cyclictest2787080-21sh12:27:512
2616281993824,10cyclictest2737135-21ssh11:17:322
2616281993824,10cyclictest2727052-21ssh11:00:312
2616281993823,11cyclictest2680402-21ssh09:51:442
2616281993823,10cyclictest2665977-21ssh09:30:112
2616281993822,10cyclictest2716542-21ps10:44:272
261628099386,24cyclictest2682200-21ssh09:54:231
2616280993830,5cyclictest2755912-21systemd-run11:45:011
2616280993830,4cyclictest2647751-21cut08:55:011
2616280993828,7cyclictest2745611-21cat11:29:281
2616280993828,7cyclictest2745611-21cat11:29:281
2616280993827,8cyclictest421-21avahi-daemon09:59:261
2616279993830,5cyclictest2635780-21systemd-run08:15:020
2616279993829,7cyclictest2640268-21/usr/sbin/munin08:30:020
2616281993730,5cyclictest2629191-21ntpq07:54:352
2616281993725,8cyclictest2638202-21ntpq08:24:182
2616281993724,10cyclictest2770083-21/usr/sbin/munin12:04:272
2616281993724,10cyclictest2704359-21sh10:25:432
2616281993723,9cyclictest2627292-21/usr/sbin/munin07:49:102
2616281993722,11cyclictest2753123-21ssh11:40:572
2616281993719,14cyclictest2632258-21modprobe08:04:212
2616281993717,11cyclictest2762916-21grep11:54:272
2616281993717,11cyclictest2762916-21grep11:54:272
2616281993713,7cyclictest0-21swapper/211:34:212
2616280993730,4cyclictest2655571-21unixbench_multi09:14:291
2616280993728,5cyclictest2700475-21cron10:20:001
2616280993728,5cyclictest2700475-21cron10:20:001
261627999374,28cyclictest2713133-21ssh10:39:240
2616279993730,4cyclictest2628277-21systemd-run07:50:010
2616279993729,5cyclictest1780530-21cupsd10:43:410
2616279993728,6cyclictest959-21mta-sts-daemon09:16:550
2616279993726,9cyclictest422-21dbus-daemon07:40:010
2616279993721,13cyclictest2705812-21aten_r2power_vo10:29:080
2616281993625,7cyclictest2636697-21ntpq08:19:212
2616281993612,8cyclictest2656128-21ssh09:15:072
261628099369,6cyclictest171rcu_preempt12:14:201
261628099366,7cyclictest171rcu_preempt11:34:181
2616280993630,3cyclictest0-21swapper/107:40:011
2616280993628,4cyclictest0-21swapper/111:24:181
2616280993628,4cyclictest0-21swapper/111:24:181
2616280993625,7cyclictest1780552-21cups-browsed10:20:151
2616279993629,4cyclictest2767006-21cron12:00:010
2616279993627,4cyclictest0-21swapper/010:49:080
2616281993523,9cyclictest2617125-21/usr/sbin/munin07:14:172
2616280993529,3cyclictest0-21swapper/108:40:011
2616280993527,5cyclictest2634270-21munin-plugin-st08:10:011
2616280993525,6cyclictest2796592-21munin-plugin-st12:40:011
261628099352,26cyclictest266-21systemd-journal08:14:221
261628099352,23cyclictest2725959-21ssh10:59:201
2616279993527,5cyclictest151ktimers/012:34:240
261627999352,29cyclictest2788408-21ssh12:29:190
2616279993520,12cyclictest151ktimers/012:09:180
2616280993428,2cyclictest0-21swapper/109:50:011
2616280993427,3cyclictest0-21swapper/112:25:021
2616280993425,6cyclictest1780530-21cupsd09:30:431
2616280993425,6cyclictest0-21swapper/111:10:011
2616280993423,7cyclictest2752605-21cron11:40:001
2616280993418,11cyclictest271ktimers/108:59:221
2616279993428,4cyclictest2662558-21systemd-run09:25:010
2616279993424,7cyclictest2770720-21ssh12:05:010
2616279993417,14cyclictest2732675-21unixbench_singl11:09:430
2616280993325,5cyclictest2629781-21systemd-run07:55:021
2616280993323,7cyclictest2766629-21timerwakeupswit11:59:311
2616280993315,13cyclictest599-21lldpd09:18:341
261627999333,21cyclictest2689410-21ssh10:04:260
2616279993323,7cyclictest2728600-21aten_r2power_po11:04:080
2616279993319,11cyclictest0-21swapper/012:14:130
2616279993314,14cyclictest12450irq/32-eth009:49:210
2616280993223,6cyclictest474-21in:imuxsock12:35:011
2616279993226,3cyclictest0-21swapper/008:45:010
2616279993224,5cyclictest421-21avahi-daemon07:34:080
2616279993221,7cyclictest0-21swapper/011:29:070
2616279993221,7cyclictest0-21swapper/011:29:070
2616279993216,9cyclictest12450irq/32-eth010:54:210
2616280993124,4cyclictest0-21swapper/112:30:021
2616280993123,5cyclictest2628262-21ls07:50:001
261628099312,23cyclictest2729263-21sh11:04:241
261628099312,20cyclictest657-21snmpd09:24:221
261627999313,25cyclictest0-21swapper/009:44:200
2616279993125,4cyclictest2763346-21latency_hist11:55:020
2616279993125,4cyclictest2763346-21latency_hist11:55:020
261627999312,22cyclictest2699704-21ssh10:19:210
261627999312,22cyclictest2699704-21ssh10:19:210
2616279993119,8cyclictest12450irq/32-eth011:14:270
2616280993024,3cyclictest0-21swapper/110:05:511
2616280993022,6cyclictest421-21avahi-daemon09:40:481
2616280993022,5cyclictest2774383-21munin-plugin-st12:10:011
2616280993022,5cyclictest2720223-21munin-run10:50:011
2616279993022,5cyclictest2649247-21idleruntime-cro09:00:010
2616281992920,6cyclictest2616234-21munin-run07:10:012
2616280992922,5cyclictest2638715-21unixbench_singl08:24:281
2616280992920,7cyclictest2734434-21sh11:13:401
2616280992912,13cyclictest271ktimers/107:24:221
2616279992924,3cyclictest2710274-21unixbench_multi10:34:340
2616279992924,3cyclictest2616278-21cyclictest09:04:180
2616279992922,5cyclictest453-21systemd-logind08:35:010
2616279992922,5cyclictest0-21swapper/007:20:010
2616279992922,3cyclictest0-21swapper/009:51:320
2616279992921,4cyclictest151ktimers/007:29:240
2616279992919,7cyclictest2651584-21needreboot09:09:140
2616279992918,6cyclictest2665381-21unixbench_multi09:29:300
2616279992917,9cyclictest1780552-21cups-browsed12:25:020
2616280992822,4cyclictest2637228-21unixbench_singl08:19:311
261628099282,19cyclictest1994697-21sendmail-mta08:49:201
2616280992821,3cyclictest0-21swapper/110:14:241
261628099281,23cyclictest2716342-21ssh10:44:181
2616279992822,4cyclictest2642229-21cpuspeed08:39:080
2616279992820,5cyclictest2646286-21latency_hist08:50:020
261627999281,22cyclictest2738486-21ssh11:19:180
2616280992721,3cyclictest0-21swapper/108:35:011
2616280992721,3cyclictest0-21swapper/108:00:011
2616280992718,7cyclictest2626019-21load07:44:141
2616280992718,7cyclictest2626019-21load07:44:141
2616280992718,6cyclictest461-21thd10:29:171
2616280992716,8cyclictest2621607-21needreboot07:29:151
2616279992721,3cyclictest0-21swapper/008:00:010
2616279992716,6cyclictest2626787-21sh07:45:010
2616279992716,6cyclictest2626787-21sh07:45:010
2616280992621,2cyclictest0-21swapper/108:45:011
2616279992621,3cyclictest956-21mta-sts-daemon08:54:180
2616280992519,3cyclictest0-21swapper/107:35:011
2616280992518,4cyclictest266-21systemd-journal08:29:251
2616280992517,5cyclictest266-21systemd-journal07:20:011
2616279992518,3cyclictest0-21swapper/008:19:190
2616279992515,6cyclictest1780552-21cups-browsed08:04:190
2616280992417,4cyclictest956-21mta-sts-daemon09:05:021
2616279992415,7cyclictest2616821-21fschecks_time07:14:120
2616279992217,3cyclictest959-21mta-sts-daemon08:20:500
2616279992216,4cyclictest12550irq/33-eth007:24:140
2616280991911,5cyclictest2616418-21latency_hist07:10:021
261628299172,8cyclictest0-21swapper/311:14:273
261628299172,8cyclictest0-21swapper/308:14:223
261628299171,8cyclictest0-21swapper/309:29:223
261628299171,7cyclictest0-21swapper/309:39:173
261627999174,9cyclictest422-21dbus-daemon07:10:010
261628299162,9cyclictest0-21swapper/310:54:233
261628299162,6cyclictest0-21swapper/309:44:143
261628299162,4cyclictest0-21swapper/310:09:213
261628299161,9cyclictest0-21swapper/311:39:233
261628299153,6cyclictest0-21swapper/312:24:213
261628299152,8cyclictest0-21swapper/310:24:273
261628299152,7cyclictest0-21swapper/312:34:183
261628299152,6cyclictest0-21swapper/312:19:173
261628299152,6cyclictest0-21swapper/312:04:183
261628299152,6cyclictest0-21swapper/308:35:013
261628299152,6cyclictest0-21swapper/307:39:173
261628299152,5cyclictest0-21swapper/312:14:193
261628299151,9cyclictest0-21swapper/311:54:173
261628299151,9cyclictest0-21swapper/311:54:173
261628299151,8cyclictest0-21swapper/312:29:233
261628299151,8cyclictest0-21swapper/309:49:173
261628299151,7cyclictest0-21swapper/311:59:203
261628299151,7cyclictest0-21swapper/311:29:193
261628299151,7cyclictest0-21swapper/311:29:193
261628299151,7cyclictest0-21swapper/308:49:163
261628299151,6cyclictest0-21swapper/308:09:183
261628299143,7cyclictest0-21swapper/309:24:173
261628299143,6cyclictest0-21swapper/310:49:183
261628299142,7cyclictest0-21swapper/311:44:403
261628299142,7cyclictest0-21swapper/311:34:243
261628299142,7cyclictest0-21swapper/311:19:233
261628299142,7cyclictest0-21swapper/310:14:233
261628299142,7cyclictest0-21swapper/309:13:333
261628299142,6cyclictest0-21swapper/311:49:183
261628299142,6cyclictest0-21swapper/311:49:183
261628299142,6cyclictest0-21swapper/309:54:163
261628299142,5cyclictest0-21swapper/309:09:163
261628299141,8cyclictest0-21swapper/310:34:183
261628299141,8cyclictest0-21swapper/309:34:243
261628299141,7cyclictest0-21swapper/310:29:243
261628299141,7cyclictest0-21swapper/308:24:173
261628299141,7cyclictest0-21swapper/307:59:223
261628299141,6cyclictest0-21swapper/307:29:163
261628299132,7cyclictest0-21swapper/311:24:173
261628299132,7cyclictest0-21swapper/311:24:173
261628299132,6cyclictest0-21swapper/310:04:223
261628299132,6cyclictest0-21swapper/309:04:183
261628299131,7cyclictest0-21swapper/312:39:253
261628299131,7cyclictest0-21swapper/312:09:253
261628299131,7cyclictest0-21swapper/308:29:163
261628299131,6cyclictest0-21swapper/310:19:153
261628299131,6cyclictest0-21swapper/310:19:153
261628299131,6cyclictest0-21swapper/308:19:183
261628299123,6cyclictest0-21swapper/307:54:333
261628299122,6cyclictest0-21swapper/311:01:013
261628299122,6cyclictest0-21swapper/310:44:303
261628299122,5cyclictest0-21swapper/307:50:003
261628299121,7cyclictest0-21swapper/311:09:253
261628299121,7cyclictest0-21swapper/310:39:243
261628299121,7cyclictest0-21swapper/309:59:223
261628299121,6cyclictest0-21swapper/309:20:033
261628299121,6cyclictest0-21swapper/308:59:183
261628299121,6cyclictest0-21swapper/308:04:223
261628299121,6cyclictest0-21swapper/307:34:183
261628299121,6cyclictest0-21swapper/307:14:193
261628299113,6cyclictest0-21swapper/310:59:063
261628299112,5cyclictest0-21swapper/308:45:013
261628299111,6cyclictest0-21swapper/308:39:223
261628299111,6cyclictest0-21swapper/307:20:013
261628299101,5cyclictest0-21swapper/308:54:103
26162829992,6cyclictest0-21swapper/307:10:013
26162829991,5cyclictest0-21swapper/307:44:123
26162829991,5cyclictest0-21swapper/307:44:123
26162829991,5cyclictest0-21swapper/307:21:333
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional