You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-05-01 - 09:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7.osadl.org (updated Wed May 01, 2024 00:43:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
13738799513,47cyclictest296293-21ntpq23:31:270
137387994220,5cyclictest0-21swapper/000:12:210
137387993822,13cyclictest297360-21ssh23:31:590
13738899353,15cyclictest305221-21wc23:41:271
13738799322,7cyclictest0-21swapper/000:20:380
137387993221,3cyclictest0-21swapper/023:41:290
13738899316,12cyclictest330436-21sh00:12:211
13738799311,8cyclictest257959-21grep22:46:380
13738899291,13cyclictest214160-21rm21:56:231
13738799286,6cyclictest0-21swapper/022:56:240
137387992824,2cyclictest244090-21ssh22:31:270
13738799280,2cyclictest0-21swapper/023:15:020
13738799280,0cyclictest0-21swapper/022:59:280
13738999272,7cyclictest171rcu_preempt00:20:382
137387992722,4cyclictest344163-21grep00:31:270
13738799272,1cyclictest251940-21head22:41:190
137387992718,3cyclictest152846-21grep19:56:330
13738799271,25cyclictest291729-21ntpq23:26:260
13738999262,7cyclictest0-21swapper/223:31:592
13738799264,18cyclictest1001-21mta-sts-daemon00:31:280
13738799262,4cyclictest11050irq/107-eth%d00:11:160
13738799261,3cyclictest287274-21sh23:21:270
13738799260,20cyclictest213949-21fschecks_time21:56:210
13738999255,8cyclictest171rcu_preempt23:31:272
13738799251,23cyclictest236209-21grep22:21:310
112299250,3rtkit-daemon1121-21rtkit-daemon21:32:090
13738799240,20cyclictest0-21swapper/023:09:420
13738799233,19cyclictest0-21swapper/023:36:320
137387992311,1cyclictest0-21swapper/000:26:250
137388992216,3cyclictest300192-21latency_hist23:36:281
13738799229,3cyclictest189063-21grep21:26:240
13738799221,21cyclictest0-21swapper/022:46:260
13738799221,12cyclictest226386-21aten2.4-expect22:11:180
13738799220,13cyclictest0-21swapper/023:56:220
13738999213,2cyclictest197842-21ntpq21:36:282
137389992118,2cyclictest146900-21latency_hist19:41:282
13738899212,2cyclictest0-21swapper/123:51:261
13738799215,4cyclictest309718-21needreboot23:46:310
13738799211,11cyclictest0-21swapper/021:56:320
13738799211,11cyclictest0-21swapper/021:56:320
13738999207,10cyclictest0-21swapper/200:26:282
13738999206,9cyclictest287383-21sort23:21:272
13738999203,10cyclictest1-21systemd21:41:272
13738899205,4cyclictest344586-21ssh00:31:281
13738899202,4cyclictest11050irq/107-eth%d23:06:281
137388992010,5cyclictest0-21swapper/119:56:281
13738799201,5cyclictest231861-21/usr/sbin/munin22:16:380
137387992012,6cyclictest150002-21fschecks_time19:51:200
13738799201,18cyclictest270673-21awk23:01:320
13738799201,12cyclictest0-21swapper/023:56:290
13738999195,11cyclictest248075-21/usr/sbin/munin22:36:252
137389991914,4cyclictest152145-21cron19:56:282
13738899196,8cyclictest265944-21/usr/sbin/munin22:56:281
137388991915,2cyclictest0-21swapper/100:21:161
137388991913,3cyclictest0-21swapper/122:16:361
13738899190,14cyclictest282845-21/usr/sbin/munin23:16:281
137387991916,2cyclictest0-21swapper/021:31:270
137387991916,1cyclictest0-21swapper/022:36:280
137387991912,6cyclictest0-21swapper/020:56:270
13738999188,8cyclictest0-21swapper/200:26:302
13738999182,8cyclictest278040-21fschecks_time23:11:202
137389991814,2cyclictest0-21swapper/223:46:392
137389991813,2cyclictest0-21swapper/220:26:272
137389991813,2cyclictest0-21swapper/220:26:272
13738999181,15cyclictest156572-21cut20:11:202
13738899183,10cyclictest139044-21latency_hist19:16:271
13738899182,12cyclictest314270-21/usr/sbin/munin23:51:301
137388991815,2cyclictest1002-21mta-sts-daemon22:58:191
137388991812,3cyclictest0-21swapper/121:31:211
13738799180,12cyclictest0-21swapper/021:41:200
13738999176,7cyclictest0-21swapper/222:51:282
13738999175,10cyclictest322549-21munin-run00:01:282
13738999172,10cyclictest205380-21ssh21:46:192
137389991712,4cyclictest261561-21ntp_kernel_pll_22:51:262
13738999171,10cyclictest150553-21systemd-run19:51:272
13738999170,4cyclictest273403-21/usr/sbin/munin23:06:172
13738899177,7cyclictest197873-21cat21:36:281
13738899174,1cyclictest0-21swapper/123:31:171
13738899173,8cyclictest260776-21aten_r2power_po22:51:171
13738899172,13cyclictest291227-21sh23:26:201
13738899171,4cyclictest0-21swapper/100:26:301
13738899171,10cyclictest270894-21unixbench_singl23:01:341
137388991710,5cyclictest0-21swapper/123:46:231
13738799178,8cyclictest167041-21cat20:41:280
13738799174,10cyclictest322584-21sendmail-msp00:01:290
112299170,3rtkit-daemon1121-21rtkit-daemon00:10:571
13738999164,10cyclictest193692-21/usr/sbin/munin21:31:282
13738999162,12cyclictest171845-21sed20:56:272
137389991613,2cyclictest317763-21cut23:56:232
137389991612,3cyclictest288048-21unixbench_multi23:21:332
137389991611,4cyclictest869998-21munin-node00:05:422
13738999161,12cyclictest305033-21idleruntime-cro23:41:272
137389991610,3cyclictest0-21swapper/200:31:342
13738899167,7cyclictest0-21swapper/120:51:311
13738899163,9cyclictest152438-21/usr/sbin/munin19:56:291
13738899162,11cyclictest1-21systemd22:31:271
13738899162,10cyclictest287210-21/usr/sbin/munin23:21:261
13738899161,8cyclictest137559-21/usr/sbin/munin19:11:281
137388991612,2cyclictest146972-21latency_hist19:41:281
13738899161,12cyclictest189503-21cat21:26:281
137388991611,2cyclictest0-21swapper/122:11:201
137388991610,5cyclictest0-21swapper/122:46:201
13738799162,9cyclictest137561-21latency_hist19:11:280
13738799162,10cyclictest137964-21timerwakeupswit19:11:320
137387991613,2cyclictest0-21swapper/021:11:200
137387991612,3cyclictest0-21swapper/020:11:280
13738799161,14cyclictest0-21swapper/019:31:280
13739099153,7cyclictest0-21swapper/323:31:273
13739099153,4cyclictest0-21swapper/323:36:283
13739099152,5cyclictest0-21swapper/300:20:383
13738999159,4cyclictest131967-21kworker/u8:1+events_unbound19:11:312
13738999158,6cyclictest210398-21ssh21:51:282
13738999158,3cyclictest218575-21/usr/sbin/munin22:01:282
13738999158,3cyclictest218575-21/usr/sbin/munin22:01:282
13738999155,6cyclictest0-21swapper/223:01:272
13738999154,5cyclictest0-21swapper/223:46:202
13738999153,3cyclictest223077-21ssh22:06:282
13738999152,8cyclictest234937-21ssh22:21:202
13738999152,10cyclictest329162-21ssh00:11:222
137389991512,2cyclictest153692-21cron20:01:272
137389991511,3cyclictest252706-21idleruntime-cro22:41:272
137389991511,1cyclictest0-21swapper/222:01:352
13738999151,10cyclictest282854-21latency_hist23:16:282
13738899159,5cyclictest164115-21grep20:31:341
13738899153,8cyclictest318745-21/usr/sbin/munin23:56:371
13738899153,8cyclictest162102-21/usr/sbin/munin20:26:271
13738899153,8cyclictest162102-21/usr/sbin/munin20:26:271
13738899152,11cyclictest140657-21ntp_states19:21:251
137388991513,1cyclictest0-21swapper/119:46:281
13738899150,13cyclictest156536-21cut20:11:201
13738799152,10cyclictest348503-21/usr/sbin/munin00:36:310
137387991512,2cyclictest0-21swapper/021:16:280
13738799150,13cyclictest210431-21cron21:51:270
112299150,1rtkit-daemon0-21swapper/019:33:160
13739099144,4cyclictest0-21swapper/300:11:163
13739099142,7cyclictest0-21swapper/323:41:223
13739099141,8cyclictest0-21swapper/321:01:273
13739099141,7cyclictest0-21swapper/322:21:273
13739099141,6cyclictest0-21swapper/300:21:293
13738999147,4cyclictest137402-21unin-run19:11:282
13738999146,5cyclictest181063-21ntpq21:16:282
13738999144,7cyclictest0-21swapper/221:01:292
13738999143,8cyclictest243587-21ssh22:31:212
13738999143,8cyclictest159487-21/usr/sbin/munin20:21:192
13738999143,7cyclictest165026-21systemd-run20:36:272
13738999142,10cyclictest239539-21/usr/sbin/munin22:26:282
13738999141,9cyclictest332674-21fschecks_count00:16:232
13738999141,11cyclictest256308-21aten_r2power_cu22:46:192
13738899149,3cyclictest205731-21grep21:46:221
13738899149,2cyclictest159436-21grep20:16:411
13738899149,2cyclictest0-21swapper/120:31:201
13738899147,6cyclictest173629-21munin-run21:01:271
13738899146,5cyclictest0-21swapper/120:46:361
13738899144,5cyclictest210504-21ntpq21:51:281
13738899143,6cyclictest176317-21fschecks_time21:11:231
13738899142,9cyclictest0-21swapper/122:36:231
13738899142,8cyclictest173926-21/usr/sbin/munin21:01:281
137388991411,2cyclictest340606-21fschecks_count00:26:201
13738899141,11cyclictest249071-21grep22:36:341
13738899141,10cyclictest323069-21/usr/sbin/munin00:01:331
13738899141,10cyclictest11050irq/107-eth%d21:16:281
137388991410,3cyclictest1003-21mta-sts-daemon22:24:061
137387991411,2cyclictest154976-21gltestperf20:06:200
137387991411,2cyclictest141386-21grep19:21:300
137387991411,2cyclictest0-21swapper/019:56:230
13738799140,9cyclictest0-21swapper/022:01:300
13738799140,8cyclictest0-21swapper/021:45:340
13738799140,4cyclictest160759-21/usr/sbin/munin20:21:350
13738799140,4cyclictest160759-21/usr/sbin/munin20:21:350
13739099133,6cyclictest0-21swapper/323:06:183
13739099133,5cyclictest0-21swapper/323:21:303
13739099133,4cyclictest0-21swapper/323:21:273
13739099132,8cyclictest0-21swapper/319:41:273
13739099132,6cyclictest0-21swapper/322:46:353
13739099131,7cyclictest0-21swapper/321:11:273
13738999139,3cyclictest0-21swapper/220:41:282
13738999138,4cyclictest175355-21ntp_kernel_pll_21:06:322
13738999136,4cyclictest0-21swapper/221:26:272
13738999133,6cyclictest144769-21aten_r2power_en19:36:202
13738999132,9cyclictest147328-21needreboot19:41:312
13738999131,9cyclictest173289-21/usr/sbin/munin21:01:222
13738999131,1cyclictest171rcu_preempt20:46:212
13738999130,9cyclictest154902-21cut20:06:202
13738899134,7cyclictest217754-21munin-node22:01:161
13738899134,7cyclictest217754-21munin-node22:01:161
13738899133,8cyclictest219548-21/usr/sbin/munin22:01:361
13738899133,6cyclictest150541-21grep19:51:271
13738899132,9cyclictest0-21swapper/119:31:311
13738899132,5cyclictest11050irq/107-eth%d00:36:281
13738899131,6cyclictest167009-21ntpq20:41:281
13738899131,10cyclictest142095-21/usr/sbin/munin19:26:231
137388991310,1cyclictest0-21swapper/119:26:281
13738899130,11cyclictest180390-21ssh21:16:211
13738799138,4cyclictest169210-21grep20:46:390
13738799137,3cyclictest185239-21awk21:21:270
13738799135,6cyclictest158444-21cut20:16:300
13738799133,8cyclictest148881-21cat19:46:280
13738799132,9cyclictest587-21mta-sts-daemon19:16:290
13738799131,8cyclictest0-21swapper/022:15:170
13738799130,2cyclictest157642-21sort20:11:300
13739099123,5cyclictest0-21swapper/321:11:303
13739099122,7cyclictest0-21swapper/323:51:233
13739099122,5cyclictest0-21swapper/322:41:193
13739099122,5cyclictest0-21swapper/320:01:283
13739099121,7cyclictest0-21swapper/321:36:283
13739099121,6cyclictest0-21swapper/320:46:203
13739099121,5cyclictest0-21swapper/322:36:183
13738999129,3cyclictest1000-21mta-sts-daemon20:46:342
13738999128,3cyclictest0-21swapper/221:21:212
13738999125,4cyclictest162752-21/usr/sbin/munin20:26:312
13738999124,5cyclictest0-21swapper/220:11:282
13738999122,6cyclictest211015-21timerandwakeup21:51:322
13738899127,4cyclictest271ktimers/120:01:311
13738899123,6cyclictest3886975-21snmpd20:41:311
13738899123,6cyclictest201573-21/usr/sbin/munin21:41:181
13738899122,6cyclictest230988-21grep22:16:281
13738799129,3cyclictest172061-21ntp_kernel_pll_20:56:280
13738799121,10cyclictest162318-21ps20:26:280
13739099115,4cyclictest0-21swapper/323:06:283
13739099114,5cyclictest0-21swapper/323:41:283
13739099114,4cyclictest0-21swapper/322:01:253
13739099114,4cyclictest0-21swapper/322:01:253
13739099114,3cyclictest0-21swapper/300:31:263
13739099113,5cyclictest0-21swapper/322:26:263
13739099113,4cyclictest0-21swapper/322:51:333
13739099113,4cyclictest0-21swapper/319:26:273
13739099112,6cyclictest0-21swapper/321:21:233
13739099112,5cyclictest0-21swapper/323:11:323
13739099112,5cyclictest0-21swapper/322:41:293
13739099112,5cyclictest0-21swapper/321:21:283
13739099111,5cyclictest0-21swapper/321:26:313
13739099110,7cyclictest0-21swapper/300:12:213
13738999115,4cyclictest138117-21/usr/sbin/munin19:16:312
13738999114,4cyclictest141079-21/usr/sbin/munin19:21:282
13738999111,6cyclictest142706-21/usr/sbin/munin19:26:282
13738999111,5cyclictest231008-21gltestperf22:16:282
13738799118,2cyclictest0-21swapper/019:41:280
13738799117,3cyclictest174211-21unixbench_singl21:01:300
13738799116,1cyclictest0-21swapper/020:31:350
13738799111,7cyclictest167712-21/usr/sbin/munin20:46:240
13739099104,3cyclictest0-21swapper/321:46:273
13739099103,4cyclictest0-21swapper/322:11:243
13739099103,4cyclictest0-21swapper/320:21:333
13739099103,4cyclictest0-21swapper/320:21:333
13739099103,3cyclictest0-21swapper/319:51:203
13739099103,3cyclictest0-21swapper/319:41:373
13739099102,6cyclictest0-21swapper/320:51:263
13739099102,4cyclictest0-21swapper/322:26:323
13739099101,3cyclictest0-21swapper/323:51:293
13739099100,6cyclictest0-21swapper/300:36:313
13739099100,5cyclictest0-21swapper/323:56:293
13739099100,5cyclictest0-21swapper/322:56:293
13739099100,5cyclictest0-21swapper/319:36:203
13738999103,4cyclictest0-21swapper/200:36:302
13738899104,4cyclictest157956-21/usr/sbin/munin20:16:201
1373909994,4cyclictest0-21swapper/320:41:283
1373909993,4cyclictest0-21swapper/321:36:343
1373909993,4cyclictest0-21swapper/321:01:283
1373909993,4cyclictest0-21swapper/320:31:323
1373909993,4cyclictest0-21swapper/319:31:273
1373909993,3cyclictest0-21swapper/320:11:283
1373909993,3cyclictest0-21swapper/319:51:323
1373909993,3cyclictest0-21swapper/319:11:303
1373909993,3cyclictest0-21swapper/300:31:283
1373909993,2cyclictest0-21swapper/320:06:263
1373909992,5cyclictest0-21swapper/320:06:293
1373909992,4cyclictest0-21swapper/319:16:313
1373909992,3cyclictest0-21swapper/322:11:283
1373909991,5cyclictest0-21swapper/320:51:313
1373909991,4cyclictest0-21swapper/320:16:303
1373909983,4cyclictest0-21swapper/321:46:333
1373909982,4cyclictest0-21swapper/322:01:293
1373909981,6cyclictest0-21swapper/319:11:283
1373909981,3cyclictest0-21swapper/321:51:323
1373909972,3cyclictest0-21swapper/320:26:293
1373909971,1cyclictest0-21swapper/300:01:333
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional