You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-20 - 14:24
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack2slot7.osadl.org (updated Tue May 20, 2025 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
276123299394,30cyclictest0-21swapper/010:51:290
276123299393,23cyclictest2845791-21ssh10:11:320
276123299392,36cyclictest2861170-21ntpq10:31:280
2761232993913,14cyclictest171rcu_preempt07:16:260
276123299391,26cyclictest2935297-21/usr/sbin/munin11:56:270
276123299371,25cyclictest0-21swapper/011:31:500
276123299362,31cyclictest0-21swapper/009:31:310
2761232993621,2cyclictest2841596-21latency10:06:230
276123499351,6cyclictest2972911-21ntpq12:36:262
2761232993421,6cyclictest0-21swapper/012:01:280
276123299341,31cyclictest0-21swapper/012:16:250
276123499335,4cyclictest171rcu_preempt11:01:432
276123399335,24cyclictest2898243-21fschecks_time11:16:231
276123399325,13cyclictest2938059-21ssh11:58:191
276123399323,18cyclictest11050irq/107-eth%d10:16:321
276123299328,21cyclictest2881640-21unixbench_singl10:56:370
276123299320,32cyclictest0-21swapper/011:16:270
2761234993111,17cyclictest2953481-21/usr/sbin/munin12:16:292
276123299314,24cyclictest11750irq/162-s-mmc012:03:380
2761232993117,5cyclictest0-21swapper/012:31:280
276123399302,5cyclictest1007-21mta-sts-daemon07:18:161
276123399301,6cyclictest11050irq/107-eth%d10:11:291
276123399301,12cyclictest2914971-21ssh11:33:191
276123399300,4cyclictest2818489-21cut09:36:251
276123299302,19cyclictest2895978-21latency_hist11:13:170
276123299301,19cyclictest2921998-21/usr/sbin/munin11:41:250
2761234992919,7cyclictest0-21swapper/210:26:282
276123399294,6cyclictest2904210-21ssh11:21:421
276123399293,5cyclictest2795018-21cut08:56:251
276123399293,24cyclictest2893694-21fschecks_count11:11:251
276123399291,10cyclictest2832717-21/usr/sbin/munin09:56:161
276123299290,23cyclictest0-21swapper/011:23:510
276123399284,20cyclictest2886810-21sendmail-msp11:03:521
276123399283,5cyclictest2852521-21grep10:21:241
276123399283,4cyclictest2771659-21cut07:46:251
276123399283,3cyclictest2806811-21fschecks_time09:21:241
276123399282,5cyclictest2822476-21grep09:41:261
276123399281,7cyclictest2860757-21grep10:31:241
276123399281,5cyclictest2779552-21latency_hist08:08:161
276123399281,4cyclictest2773291-21grep07:51:441
276123399281,24cyclictest2785118-21fschecks_count08:26:241
276123399274,17cyclictest11050irq/107-eth%d12:06:291
276123399273,3cyclictest0-21swapper/109:46:251
276123399272,5cyclictest2962734-21aten_r2power_cu12:26:241
276123399272,3cyclictest2801021-21cron09:13:161
276123399271,7cyclictest2921890-21tune2fs11:41:241
276123399271,6cyclictest2791744-21fschecks_time08:47:071
276123399271,5cyclictest2958530-21sed12:21:241
276123399271,5cyclictest2912262-21sed11:31:231
276123299272,19cyclictest2852376-21aten_r2power_vo10:21:230
2761232992716,3cyclictest0-21swapper/007:36:240
276123499264,3cyclictest2824405-21sendmail-msp09:43:192
2761234992614,10cyclictest2801028-21diskmemload10:12:482
276123399263,4cyclictest2776549-21cut08:01:261
276123399262,9cyclictest2835473-21apt-config09:58:171
276123399262,7cyclictest0-21swapper/109:16:241
276123399262,5cyclictest2763379-21fschecks_count07:21:241
276123399262,3cyclictest2769421-21cron07:38:161
276123399262,21cyclictest2784456-21/usr/sbin/munin08:21:341
276123399261,5cyclictest2798341-21grep09:06:271
276123399261,5cyclictest2769804-21aten_r2power_po07:41:211
276123399261,4cyclictest2789513-21grep08:38:161
276123399260,8cyclictest2881369-21cat10:56:361
276123299262,5cyclictest607-21dbus-daemon07:13:160
2761232992617,1cyclictest2926587-21grep11:46:260
2761232992615,4cyclictest2849447-21ntpq10:16:320
276123399255,16cyclictest2907775-21/usr/sbin/munin11:26:251
276123399254,7cyclictest2857567-21unixbench_multi10:26:341
276123399253,3cyclictest2774987-21fschecks_time07:56:261
276123399252,6cyclictest2780202-21fschecks_count08:11:231
276123399251,9cyclictest2878807-21cat10:53:171
276123399251,8cyclictest2796934-21grep09:01:481
276123399251,7cyclictest2793152-21head08:51:221
276123399251,4cyclictest2931575-21ntpq11:51:271
276123399251,4cyclictest2810811-21gltestperf09:26:241
2761233992514,10cyclictest2967700-21grep12:31:231
276123399251,13cyclictest2926787-21cat11:46:271
276123399250,4cyclictest2766702-21fschecks_count07:31:241
2761232992514,4cyclictest0-21swapper/012:41:550
276123399244,18cyclictest2937801-21latency_hist11:58:161
276123399242,5cyclictest2761210-21systemd-run07:13:161
276123399242,5cyclictest0-21swapper/108:16:261
276123399242,4cyclictest2872910-21wc10:46:261
276123399241,6cyclictest2841045-21head10:06:201
276123399241,6cyclictest2789918-21aten2.4-expect08:41:221
276123399241,5cyclictest2954211-21ssh12:16:251
2761232992420,3cyclictest0-21swapper/012:21:250
276123399234,2cyclictest2814585-21cut09:31:261
276123399233,6cyclictest2972344-21grep12:36:231
276123399233,5cyclictest0-21swapper/111:01:231
276123399233,4cyclictest2765855-21wc07:26:321
276123399232,6cyclictest2868694-21grep10:41:231
276123399232,5cyclictest2949319-21grep12:11:251
276123299235,16cyclictest2803096-21fschecks_time09:16:240
276123299232,4cyclictest2791190-21kworker/u8:0+flush-179:010:44:190
276123299232,3cyclictest171rcu_preempt11:21:420
276123299232,20cyclictest11050irq/107-eth%d08:06:310
276123499222,5cyclictest171rcu_preempt12:26:312
276123499222,13cyclictest2860758-21gltestperf10:31:242
276123499221,3cyclictest2968243-21ntpq12:31:272
276123399222,7cyclictest0-21swapper/108:31:251
276123399221,7cyclictest2977078-21gltestperf12:41:231
276123299222,19cyclictest2962975-21/usr/sbin/munin12:26:260
276123299222,19cyclictest2808656-21sh09:23:160
2761232992218,3cyclictest2818524-21grep09:36:250
276123499211,5cyclictest36-21ksoftirqd/211:26:592
276123399212,7cyclictest2865743-21/usr/sbin/munin10:36:371
276123299210,18cyclictest0-21swapper/008:41:220
112699210,3rtkit-daemon1125-21rtkit-daemon08:51:252
276123499204,11cyclictest2835880-21ssh09:58:492
276123299202,13cyclictest2891363-21munin-run11:08:160
276123299201,9cyclictest0-21swapper/009:26:260
276123299201,1cyclictest171rcu_preempt09:43:190
276123299201,19cyclictest0-21swapper/009:51:290
276123599193,7cyclictest0-21swapper/312:41:333
276123599193,7cyclictest0-21swapper/309:58:183
276123499194,14cyclictest11050irq/107-eth%d10:51:292
276123499192,2cyclictest0-21swapper/210:21:242
276123499191,11cyclictest2842097-21ssh10:06:312
276123499190,13cyclictest0-21swapper/208:36:562
276123399190,2cyclictest2831331-21latency_hist09:53:161
276123299197,3cyclictest0-21swapper/012:11:290
276123299191,9cyclictest0-21swapper/010:42:360
276123299191,14cyclictest1005-21mta-sts-daemon09:58:180
112699190,1rtkit-daemon0-21swapper/009:04:130
276123599184,7cyclictest0-21swapper/310:31:283
276123499189,7cyclictest2917671-21ntpq11:36:272
276123499186,2cyclictest171rcu_preempt09:26:242
276123499185,5cyclictest171rcu_preempt09:11:262
276123499184,12cyclictest0-21swapper/211:11:292
276123499181,3cyclictest0-21swapper/210:37:232
276123499181,3cyclictest0-21swapper/209:01:512
2761234991813,4cyclictest2761231-21cyclictest09:08:162
276123499180,2cyclictest2786473-21/usr/sbin/munin08:31:362
276123299188,1cyclictest2914365-21apt-get11:33:180
276123299183,10cyclictest111788-21systemd-journal10:23:330
2761232991813,4cyclictest2786131-21grep08:26:350
276123299180,2cyclictest2886774-21apt11:03:160
276123499176,4cyclictest171rcu_preempt07:13:162
276123499174,3cyclictest171rcu_preempt07:16:252
276123499174,10cyclictest1005-21mta-sts-daemon11:14:102
276123499173,2cyclictest2773314-21fschecks_time07:51:442
276123499173,12cyclictest2849475-21ssh10:16:322
276123499172,10cyclictest2779585-21cmp08:08:162
276123499171,3cyclictest2780737-21ntpq08:11:272
2761234991711,5cyclictest0-21swapper/212:01:292
276123499170,9cyclictest0-21swapper/212:11:262
276123499170,6cyclictest2801028-21diskmemload12:41:232
276123299175,8cyclictest2822475-21tune2fs09:41:260
276123299173,12cyclictest2835052-21munin-run09:58:160
276123299172,8cyclictest11050irq/107-eth%d12:36:260
2761232991714,2cyclictest2931322-21kernelversion11:51:250
276123599164,6cyclictest0-21swapper/309:06:263
276123499169,6cyclictest633-21gpm09:57:572
276123499165,5cyclictest2803603-21ntpq09:16:292
276123499165,4cyclictest2959429-21grep12:21:342
276123499165,10cyclictest122792-21ntpd09:42:242
276123499164,10cyclictest2942397-21sendmail-msp12:03:382
276123499163,5cyclictest2889416-21/usr/sbin/munin11:06:252
276123499163,3cyclictest0-21swapper/210:56:322
276123499162,4cyclictest2931242-21if_end011:51:242
276123499162,0cyclictest11050irq/107-eth%d11:46:242
276123499161,9cyclictest2772721-21cron07:48:162
2761234991613,2cyclictest2870575-21idleruntime-cro10:43:162
276123499161,2cyclictest171rcu_preempt08:41:272
276123299165,9cyclictest2792727-21sed08:47:350
2761232991613,2cyclictest2772667-21grep07:46:350
276123299161,14cyclictest0-21swapper/007:56:250
276123599153,6cyclictest0-21swapper/312:16:293
276123599153,6cyclictest0-21swapper/309:43:193
276123499159,3cyclictest0-21swapper/209:31:362
276123499155,9cyclictest122792-21ntpd07:38:162
276123499155,7cyclictest351ktimers/207:21:282
276123499155,1cyclictest2782329-21ntpq08:16:282
276123499153,9cyclictest2818129-21/usr/sbin/munin09:36:352
276123499153,9cyclictest2791880-21sed08:47:082
276123499152,3cyclictest2921596-21ssh11:41:222
276123499152,2cyclictest2795502-21ntpq08:56:282
276123499152,2cyclictest2783629-21gltestperf08:21:242
2761234991511,3cyclictest2786183-21unixbench_singl08:26:352
276123499151,12cyclictest2903455-21ntpq11:21:272
2761234991510,4cyclictest351ktimers/207:26:282
276123499150,8cyclictest0-21swapper/207:56:292
276123299157,6cyclictest0-21swapper/009:11:240
276123299157,4cyclictest0-21swapper/008:51:210
276123299153,7cyclictest2797106-21/usr/sbin/munin09:01:500
2761232991510,4cyclictest0-21swapper/008:31:310
276123299150,4cyclictest2795527-21ntpq08:56:290
276123599146,4cyclictest0-21swapper/311:33:193
276123599143,6cyclictest0-21swapper/311:41:233
276123599142,7cyclictest0-21swapper/311:21:233
276123599142,6cyclictest0-21swapper/308:06:233
276123499149,3cyclictest0-21swapper/209:53:162
276123499149,1cyclictest171rcu_preempt11:56:222
276123499144,7cyclictest111788-21systemd-journal10:48:162
276123499144,3cyclictest171rcu_preempt11:33:162
276123299145,5cyclictest2864394-21/usr/sbin/munin10:36:250
276123299144,5cyclictest111788-21systemd-journal08:38:160
276123299143,8cyclictest2781894-21fschecks_time08:16:250
276123299142,10cyclictest2773539-21/usr/sbin/munin07:51:460
276123599134,5cyclictest0-21swapper/308:41:333
276123599134,4cyclictest0-21swapper/312:27:143
276123599133,6cyclictest0-21swapper/308:31:313
276123599133,5cyclictest0-21swapper/312:03:383
276123599133,5cyclictest0-21swapper/309:36:263
276123599133,5cyclictest0-21swapper/307:21:253
276123599133,4cyclictest0-21swapper/310:10:393
276123599132,7cyclictest0-21swapper/311:26:233
276123599132,7cyclictest0-21swapper/311:11:273
276123599132,6cyclictest0-21swapper/312:11:233
276123599132,5cyclictest0-21swapper/311:56:243
276123599131,6cyclictest0-21swapper/308:16:253
276123599131,5cyclictest0-21swapper/311:31:183
276123499132,3cyclictest762-21in:imuxsock09:23:162
276123499131,8cyclictest2766724-21cut07:31:242
276123499131,10cyclictest2777294-21/usr/sbin/munin08:01:342
276123299137,1cyclictest0-21swapper/007:31:270
276123299133,6cyclictest2765287-21/usr/sbin/munin07:26:240
276123299130,8cyclictest2783174-21/usr/sbin/munin08:21:340
276123599125,4cyclictest0-21swapper/309:31:363
276123599123,7cyclictest0-21swapper/312:21:333
276123599123,6cyclictest0-21swapper/310:43:173
276123599123,4cyclictest0-21swapper/311:46:243
276123599123,4cyclictest0-21swapper/310:18:433
276123599122,6cyclictest0-21swapper/309:01:563
276123599122,6cyclictest0-21swapper/307:26:323
276123599121,8cyclictest0-21swapper/309:41:263
276123599121,7cyclictest0-21swapper/310:56:273
276123599121,6cyclictest0-21swapper/312:31:303
276123599121,5cyclictest0-21swapper/309:56:113
276123599120,7cyclictest0-21swapper/310:51:293
276123499123,6cyclictest2770684-21/usr/sbin/munin07:41:302
276123299126,1cyclictest0-21swapper/007:21:290
276123299124,7cyclictest151ktimers/008:01:260
276123299122,8cyclictest2769975-21cut07:41:230
276123299120,11cyclictest2780179-21cut08:11:230
276123599115,4cyclictest0-21swapper/309:26:283
276123599115,2cyclictest0-21swapper/308:11:293
276123599114,4cyclictest0-21swapper/308:51:273
276123599114,3cyclictest0-21swapper/307:31:293
276123599113,5cyclictest0-21swapper/308:56:223
276123599113,4cyclictest0-21swapper/312:01:243
276123599112,5cyclictest0-21swapper/311:50:153
276123599112,5cyclictest0-21swapper/308:26:223
276123599111,7cyclictest0-21swapper/310:26:273
276123599111,6cyclictest0-21swapper/309:16:353
276123599111,5cyclictest0-21swapper/311:06:243
276123599111,5cyclictest0-21swapper/310:41:233
276123599106,2cyclictest0-21swapper/310:06:213
276123599105,3cyclictest0-21swapper/312:36:263
276123599103,5cyclictest0-21swapper/309:11:253
276123599103,4cyclictest0-21swapper/310:16:253
276123599103,4cyclictest0-21swapper/308:36:523
276123599102,5cyclictest0-21swapper/310:36:273
276123599102,5cyclictest0-21swapper/308:47:113
276123599102,5cyclictest0-21swapper/308:23:163
276123599102,4cyclictest0-21swapper/311:14:103
276123599102,4cyclictest0-21swapper/307:51:443
276123599102,3cyclictest0-21swapper/307:41:203
276123599101,6cyclictest0-21swapper/307:46:253
276123599101,5cyclictest0-21swapper/307:36:263
27612359993,4cyclictest0-21swapper/307:56:233
27612359993,4cyclictest0-21swapper/307:16:273
27612359992,4cyclictest0-21swapper/310:58:283
27612359992,4cyclictest0-21swapper/309:48:393
27612359991,5cyclictest0-21swapper/309:21:263
27612359991,5cyclictest0-21swapper/308:01:253
27612359951,3cyclictest0-21swapper/307:13:163
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional