You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-22 - 14:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Mon Dec 22, 2025 00:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2906563995129,18cyclictest3001350-21grep23:40:270
2906568995026,20cyclictest0-21swapper/123:00:171
2906568994929,17cyclictest3001353-21unixbench_singl23:40:261
2906563994920,26cyclictest0-21swapper/000:15:270
2906568994739,5cyclictest2989824-21ls23:10:001
2906563994721,22cyclictest0-21swapper/000:35:000
2906563994721,22cyclictest0-21swapper/000:35:000
2906576994537,5cyclictest3008121-21unixbench_multi00:00:273
2906576994536,5cyclictest2955285-21sh21:30:003
2906576994536,5cyclictest2955285-21sh21:30:003
2906576994532,10cyclictest391ktimers/323:45:153
2906563994518,24cyclictest2960632-21idleruntime-cro21:45:000
290656399451,11cyclictest2964255-21apt-get21:55:110
2906571994336,4cyclictest2991512-21cron23:15:002
2906568994335,4cyclictest0-21swapper/123:49:591
2906568994325,14cyclictest0-21swapper/122:05:001
290656399431,9cyclictest2988642-21/usr/sbin/munin23:05:160
290656399431,37cyclictest2921134-21/usr/sbin/munin19:50:160
290656399431,36cyclictest2930063-21/usr/sbin/munin20:15:210
2906568994232,6cyclictest2996653-21munin-plugin-st23:30:001
2906568994220,18cyclictest2958501-21grep21:35:291
2906568994210,8cyclictest2928899-21sed20:10:291
2906563994235,4cyclictest3005161-21cron23:55:000
290656399422,27cyclictest2946367-21users21:00:270
290656399421,3cyclictest2998586-21apt-get23:35:150
290656399421,39cyclictest0-21swapper/021:05:180
290656399421,36cyclictest2995359-21tune2fs23:25:150
290656399421,36cyclictest2971293-21apt-get22:15:150
290656399421,36cyclictest2950607-21fschecks_time21:15:170
290656899412,8cyclictest2932053-21proc_pri20:20:221
290656399412,34cyclictest2935077-21/usr/sbin/munin20:30:150
290656399411,9cyclictest3019706-21/usr/sbin/munin00:35:180
290656399411,9cyclictest3019706-21/usr/sbin/munin00:35:180
290656399411,4cyclictest29137662sleep019:28:090
290656399411,3cyclictest2969820-21perl22:10:170
290656399411,37cyclictest2975434-21/usr/sbin/munin22:25:240
290656399411,37cyclictest2924960-21/usr/sbin/munin20:00:180
290656399411,35cyclictest2996882-21apt-get23:30:120
290656399411,35cyclictest2996882-21apt-get23:30:110
290656399411,35cyclictest2922889-21/usr/sbin/munin19:55:170
290656399411,35cyclictest2916194-21/usr/sbin/munin19:35:180
290656899402,9cyclictest2922445-21auditctl19:55:001
2906568994013,23cyclictest0-21swapper/123:30:171
2906568994013,23cyclictest0-21swapper/123:30:171
2906568994011,7cyclictest204-21dbus-daemon23:13:161
290656899401,10cyclictest3005160-21cron23:55:011
290656399402,33cyclictest2976858-21meminfo22:30:190
290656399401,8cyclictest2909577-21/usr/sbin/munin19:15:220
2906563994018,19cyclictest0-21swapper/020:40:010
290656399401,7cyclictest2931982-21/usr/sbin/munin20:20:210
290656399401,4cyclictest0-21swapper/020:50:120
290656399401,36cyclictest2973693-21/usr/sbin/munin22:20:240
290656399401,36cyclictest2949020-21/usr/sbin/munin21:10:190
290656399401,34cyclictest3010977-21/usr/sbin/munin00:10:180
290656399401,34cyclictest2991762-21/usr/sbin/munin23:15:130
290656399401,34cyclictest2990396-21/usr/sbin/munin23:10:200
290656399401,34cyclictest2955518-21/usr/sbin/munin21:30:120
290656399400,35cyclictest0-21swapper/023:55:110
290656399400,2cyclictest0-21swapper/021:50:140
2906576993929,6cyclictest2910536-21sendmail19:20:013
2906571993928,8cyclictest2906555-21cyclictest22:50:002
290656899392,11cyclictest2974467-21cron22:25:011
290656899391,9cyclictest2924140-21cron20:00:001
2906568993911,3cyclictest2950302-21latency_hist21:15:001
290656899391,11cyclictest2993219-21cron23:20:001
290656899391,10cyclictest3009815-21unixbench_multi00:05:261
290656399392,23cyclictest3008678-21latency_hist00:05:010
290656399392,20cyclictest0-21swapper/019:15:010
290656399391,4cyclictest2978996-21ls22:35:250
290656399391,35cyclictest2979937-21df22:40:140
290656399391,35cyclictest2966159-21/usr/sbin/munin22:00:170
290656399391,35cyclictest2944322-21/usr/sbin/munin20:55:250
290656399391,35cyclictest2918795-21sshd19:42:090
290656399391,33cyclictest3015923-21/usr/sbin/munin00:25:160
290656399391,33cyclictest2985054-21/usr/sbin/munin22:55:170
290656399391,33cyclictest2983803-21ntp_states22:50:210
290656399391,33cyclictest2968937-21unixbench_singl22:05:260
290656399391,33cyclictest2954127-21/usr/sbin/munin21:25:200
290656399391,33cyclictest2954127-21/usr/sbin/munin21:25:200
290656399391,11cyclictest2933254-21diskstats20:25:150
2906576993827,7cyclictest0-21swapper/321:40:273
2906571993824,4cyclictest131rcu_preempt23:53:082
290656899382,7cyclictest2982566-21grep22:45:251
290656899381,8cyclictest2993475-21/usr/sbin/munin23:20:201
2906568993813,22cyclictest0-21swapper/120:50:171
290656899381,10cyclictest2985463-21tr22:55:211
290656399385,28cyclictest2961150-21if_eth021:45:170
290656399381,6cyclictest2958638-21cron21:37:000
290656399381,34cyclictest2987938-21cron23:02:590
290656399381,34cyclictest2952361-21/usr/sbin/munin21:20:150
290656399381,34cyclictest2952361-21/usr/sbin/munin21:20:150
290656399381,33cyclictest3002006-21/usr/sbin/munin23:45:140
290656399381,32cyclictest2919368-21/usr/sbin/munin19:45:150
290656399381,31cyclictest2926149-21/usr/sbin/munin20:05:120
290656399381,2cyclictest3008830-21apt-get00:05:130
290656399381,2cyclictest0-21swapper/020:40:140
290656399381,10cyclictest3014254-21cstates00:20:140
2906576993729,6cyclictest2923946-21kworker/u8:3+events_unbound20:02:433
2906576993726,8cyclictest3004713-21grep23:50:263
2906571993730,4cyclictest2965718-21cron22:00:002
2906571993729,5cyclictest2909251-21fschecks_time19:15:172
2906571993724,9cyclictest2950611-21fschecks_time21:15:172
290656899372,5cyclictest2925087-21wc20:00:231
290656899372,5cyclictest0-21swapper/100:35:211
290656899372,5cyclictest0-21swapper/100:35:211
290656899372,11cyclictest164-21systemd-journal22:43:101
290656899371,9cyclictest2976570-21fschecks_count22:30:151
290656899371,9cyclictest2964260-21/usr/sbin/munin21:55:131
290656899371,9cyclictest2936500-21date20:35:021
290656899371,8cyclictest3016492-21grep00:25:251
2906568993711,3cyclictest2983373-21fschecks_count22:50:151
2906568993710,24cyclictest0-21swapper/100:00:131
2906568993710,23cyclictest0-21swapper/122:05:201
290656399373,20cyclictest2910863-21df19:20:160
290656399371,4cyclictest2981536-21apt-get22:45:120
290656399371,3cyclictest2928014-21apt-get20:10:170
290656399371,33cyclictest2940279-21df20:45:160
290656399370,4cyclictest0-21swapper/019:30:120
2906576993627,5cyclictest2961017-21fschecks_count21:45:153
2906576993624,8cyclictest2965257-21grep21:55:243
2906571993627,6cyclictest3020741-21sendmail00:40:002
2906571993627,6cyclictest3020741-21sendmail00:40:002
290656899367,5cyclictest0-21swapper/123:35:201
290656899365,6cyclictest0-21swapper/119:10:261
290656899363,8cyclictest2950608-21grep21:15:161
290656899363,5cyclictest2970121-21ntpq22:10:221
290656899363,5cyclictest0-21swapper/119:25:171
290656899362,9cyclictest2910628-21latency_hist19:20:021
290656899362,8cyclictest2963489-21timerwakeupswit21:50:261
290656899362,6cyclictest2927689-21cat20:10:011
290656899362,6cyclictest2917325-21latency_hist19:40:011
290656899362,5cyclictest3013455-21grep00:15:271
290656899362,5cyclictest2944558-21grep20:55:281
290656899362,5cyclictest2919463-21cut19:45:171
290656899361,9cyclictest3006388-21grep23:55:251
290656899361,9cyclictest2945912-21proc_pri21:00:241
290656899361,9cyclictest2914160-21apt-get19:30:131
290656899361,8cyclictest3017566-21/usr/sbin/munin00:30:191
290656899361,8cyclictest3017566-21/usr/sbin/munin00:30:181
290656899361,8cyclictest3014698-21ntpq00:20:231
290656899361,7cyclictest2979148-21unixbench_singl22:35:271
290656899361,7cyclictest2952301-21grep21:20:151
290656899361,7cyclictest2952301-21grep21:20:151
290656899361,10cyclictest3010851-21df_inode00:10:151
290656899361,10cyclictest2918448-21/usr/sbin/munin19:40:241
290656399361,31cyclictest2994042-21ntp_states23:20:210
2906576993529,4cyclictest2943092-21kworker/u8:2+events_unbound20:52:533
2906571993527,4cyclictest0-21swapper/222:30:162
2906571993525,6cyclictest0-21swapper/220:50:272
2906571993524,7cyclictest2945454-21fschecks_count21:00:172
290656899357,4cyclictest2960137-21unixbench_multi21:40:281
290656899352,6cyclictest2972788-21idleruntime-cro22:20:011
290656899352,5cyclictest2934607-21munin-run20:30:011
290656899351,9cyclictest2975741-21unixbench_singl22:25:261
290656899351,9cyclictest2956204-21/usr/sbin/munin21:30:231
290656899351,9cyclictest2911387-21grep19:20:241
290656899351,8cyclictest2960993-21fschecks_count21:45:161
290656899351,8cyclictest2947977-21grep21:05:271
290656899351,8cyclictest2941236-21grep20:45:261
290656899351,8cyclictest2938467-21/usr/sbin/munin20:40:241
290656899351,7cyclictest2954511-21wc21:25:261
290656899351,7cyclictest2954511-21wc21:25:261
2906576993426,4cyclictest0-21swapper/321:15:173
2906576993424,6cyclictest0-21swapper/319:35:013
2906571993425,6cyclictest3011742-21grep00:10:272
2906571993425,6cyclictest0-21swapper/222:05:012
290656899341,10cyclictest2937425-21ps20:35:271
2906576993324,5cyclictest0-21swapper/321:55:013
2906576993324,5cyclictest0-21swapper/319:20:273
2906576993319,10cyclictest391ktimers/323:55:103
290657199337,6cyclictest32-21ksoftirqd/221:30:262
2906571993324,6cyclictest2955278-21sh21:30:002
2906571993324,6cyclictest2955278-21sh21:29:592
2906571993323,6cyclictest0-21swapper/223:30:262
2906571993323,6cyclictest0-21swapper/223:30:252
2906571993321,6cyclictest131rcu_preempt21:42:082
2906576993223,5cyclictest2927086-21unixbench_multi20:05:243
2906576993223,4cyclictest0-21swapper/320:10:213
2906576993221,7cyclictest2994481-21grep23:20:253
290657199328,5cyclictest32-21ksoftirqd/222:40:192
2906571993224,4cyclictest0-21swapper/220:45:272
2906571993224,4cyclictest0-21swapper/219:20:262
2906571993221,6cyclictest0-21swapper/221:10:272
2906576993123,4cyclictest0-21swapper/319:10:253
2906576993121,7cyclictest2920270-21grep19:45:263
2906571993124,4cyclictest0-21swapper/223:05:162
2906571993124,4cyclictest0-21swapper/221:45:252
2906571993123,5cyclictest2929475-21auditctl20:15:002
2906576993022,4cyclictest0-21swapper/321:05:183
2906576993020,7cyclictest2997911-21grep23:30:263
2906576993020,7cyclictest2997911-21grep23:30:253
2906576993019,7cyclictest2958429-21grep21:35:293
2906576993019,6cyclictest0-21swapper/323:20:003
290657199308,6cyclictest0-21swapper/219:50:262
2906571993023,3cyclictest0-21swapper/222:15:202
2906571993023,3cyclictest0-21swapper/220:25:262
2906571993022,4cyclictest0-21swapper/222:55:272
2906571993022,4cyclictest0-21swapper/219:35:262
2906571993022,4cyclictest0-21swapper/200:30:172
2906571993022,4cyclictest0-21swapper/200:30:162
2906571993021,6cyclictest0-21swapper/219:50:002
2906571993020,6cyclictest0-21swapper/220:00:012
2906571993011,6cyclictest32-21ksoftirqd/221:05:162
2906576992922,3cyclictest2924147-21kthreadd20:00:013
2906576992921,4cyclictest0-21swapper/322:05:273
2906576992918,6cyclictest0-21swapper/323:25:253
2906576992915,10cyclictest391ktimers/322:20:133
290657199298,5cyclictest0-21swapper/223:40:182
290657199298,5cyclictest0-21swapper/222:50:242
2906571992918,6cyclictest0-21swapper/223:15:242
2906576992821,4cyclictest2945065-21sendmail-msp21:00:003
2906576992820,4cyclictest0-21swapper/322:30:253
2906576992818,6cyclictest2934137-21grep20:25:243
2906576992816,8cyclictest2930699-21grep20:15:283
290657199288,5cyclictest32-21ksoftirqd/220:05:122
290657199285,6cyclictest0-21swapper/223:45:252
2906571992822,3cyclictest2979581-21kthreadd22:40:012
2906571992819,6cyclictest2931966-21grep20:20:212
2906571992813,4cyclictest131rcu_preempt19:40:192
2906576992721,3cyclictest0-21swapper/320:30:223
2906576992720,4cyclictest2975752-21head22:25:263
2906576992718,6cyclictest2938631-21cut20:40:183
2906576992716,8cyclictest391ktimers/320:45:143
290657199278,6cyclictest32-21ksoftirqd/222:20:182
290657199278,13cyclictest32-21ksoftirqd/220:30:222
2906571992719,5cyclictest0-21swapper/222:05:262
2906571992717,6cyclictest0-21swapper/220:00:252
2906571992714,4cyclictest131rcu_preempt22:26:292
2906571992713,10cyclictest2987780-21seq23:01:032
2906571992710,4cyclictest32-21ksoftirqd/221:35:252
2906576992619,4cyclictest2967034-21grep22:00:273
2906576992617,6cyclictest2988116-21sh23:05:013
2906576992617,5cyclictest0-21swapper/322:10:253
290657699260,5cyclictest0-21swapper/321:31:233
290657199269,5cyclictest32-21ksoftirqd/219:10:212
290657199269,3cyclictest131rcu_preempt21:50:492
290657199268,13cyclictest3010580-21date00:10:012
290657199268,10cyclictest131rcu_preempt23:58:162
290657199265,14cyclictest0-21swapper/200:19:312
2906571992620,3cyclictest0-21swapper/220:20:012
2906571992619,3cyclictest0-21swapper/200:20:172
2906571992615,5cyclictest131rcu_preempt00:25:312
290657199260,9cyclictest32-21ksoftirqd/221:24:262
290657199260,9cyclictest32-21ksoftirqd/221:24:262
2906576992519,4cyclictest3001634-21kworker/u8:2+events_unbound00:29:343
2906576992517,6cyclictest2944828-21kworker/u8:0+events_unbound21:12:563
2906576992517,5cyclictest0-21swapper/323:40:273
2906576992516,6cyclictest0-21swapper/300:20:003
290657699251,13cyclictest2945294-21runrttasks21:00:123
290657199258,11cyclictest32-21ksoftirqd/200:01:072
2906571992516,6cyclictest0-21swapper/219:30:012
2906571992514,4cyclictest131rcu_preempt20:35:132
2906576992419,3cyclictest2971494-21fschecks_time22:15:193
2906576992417,5cyclictest3001634-21kworker/u8:2+events_unbound00:13:443
2906576992417,4cyclictest0-21swapper/300:30:273
2906576992417,4cyclictest0-21swapper/300:30:273
2906576992416,4cyclictest0-21swapper/320:35:293
2906576992416,4cyclictest0-21swapper/320:20:263
2906576992414,6cyclictest2991104-21grep23:10:273
290657199248,9cyclictest131rcu_preempt23:24:442
290657199247,4cyclictest0-21swapper/222:10:222
290657199247,10cyclictest131rcu_preempt20:55:212
290657199245,5cyclictest0-21swapper/223:25:232
2906571992416,5cyclictest0-21swapper/220:40:162
2906571992412,3cyclictest131rcu_preempt19:30:392
2906576992315,5cyclictest0-21swapper/319:35:233
290657699222,15cyclictest2986392-21cron23:00:013
2906576992217,2cyclictest0-21swapper/300:35:153
2906576992217,2cyclictest0-21swapper/300:35:143
2906576992216,3cyclictest0-21swapper/300:05:203
2906576992214,5cyclictest391ktimers/319:25:153
2906576992214,5cyclictest0-21swapper/322:35:273
2906576992213,5cyclictest0-21swapper/323:35:193
2906576992211,8cyclictest2982105-21ntp_states22:45:223
2906576992116,3cyclictest2980004-21fschecks_count22:40:153
290657699206,4cyclictest2952323-21fschecks_time21:20:153
290657699206,4cyclictest2952323-21fschecks_time21:20:143
2906576992015,3cyclictest0-21swapper/323:05:223
2906576992012,6cyclictest2975809-21kworker/u8:1+events_unbound22:53:113
2906576992011,6cyclictest2921542-21ntpq19:50:223
2906576991913,3cyclictest3014373-21fschecks_time00:20:163
2906576991913,3cyclictest0-21swapper/319:40:193
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional