You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-27 - 07:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Thu Apr 25, 2024 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4051052995644,8cyclictest284-21systemd-journal21:50:470
4051054995243,5cyclictest4110853-21systemd-run21:45:142
4051052995242,5cyclictest1724773-21mta-sts-daemon00:10:530
4051053994821,5cyclictest0-21swapper/122:00:431
4051054994638,5cyclictest4146419-21basename22:30:202
4051052994632,9cyclictest529-21gdbus21:45:170
4051052994628,15cyclictest151ktimers/022:50:400
4051053994534,8cyclictest4159413-21unixbench_multi22:46:051
4051053994430,8cyclictest4131810-21sshd22:10:451
4051053994428,11cyclictest4135735-21ssh22:15:461
405105499435,29cyclictest4192476-21ssh23:30:332
405105399430,34cyclictest4189545-21ssh23:26:211
4051052994332,8cyclictest4048209-21apt-get19:14:030
4051052994332,8cyclictest1725266-21mta-sts-daemon19:21:530
4051052994329,10cyclictest16643-21latency_hist23:55:210
4051052994326,14cyclictest4065915-21munin-plugin-st20:10:110
4051054994231,7cyclictest33464-21aten_r2power_cu00:20:322
4051054994231,7cyclictest33464-21aten_r2power_cu00:20:322
4051053994232,7cyclictest4086261-21awk21:11:021
405105299423,29cyclictest4166330-21ssh22:55:380
4051052994230,6cyclictest0-21swapper/022:35:410
4051052994228,11cyclictest1724773-21mta-sts-daemon21:21:020
4051054994132,6cyclictest4068931-21grep20:15:542
4051053994133,5cyclictest4130592-21systemd-run22:10:151
4051052994127,4cyclictest151ktimers/000:30:410
405105499403,30cyclictest4115999-21ssh21:50:472
4051054994032,5cyclictest284-21systemd-journal21:20:372
4051053994030,8cyclictest3019476-1kworker/1:2H+kblockd23:15:521
4051053994029,8cyclictest4146334-21latency_hist22:30:191
4051053994029,8cyclictest4146334-21latency_hist22:30:191
4051053994026,11cyclictest824082-21snmpd23:45:151
4051052994033,5cyclictest4051050-21cyclictest00:35:430
4051054993829,5cyclictest4056671-21aten_r2power_po19:40:412
4051054993829,5cyclictest39246-21ssh00:30:182
4051054993828,6cyclictest4056040-21cron19:35:102
4051054993828,6cyclictest4056040-21cron19:35:102
405105499382,27cyclictest28174-21ssh00:10:362
4051054993821,9cyclictest4135730-21awk22:15:482
4051052993826,9cyclictest4135840-21ntp_states22:16:020
405105299382,17cyclictest4048209-21apt-get19:42:230
4051054993731,3cyclictest4074286-21fschecks_time20:35:232
4051054993730,4cyclictest0-21swapper/221:15:322
4051054993725,9cyclictest4056514-21/usr/sbin/munin19:43:042
4051054993725,9cyclictest1725264-21mta-sts-daemon23:25:472
4051053993730,3cyclictest0-21swapper/121:29:461
4051053993729,5cyclictest42813-21aten_r2power_cu00:35:221
405105299371,31cyclictest4192573-21ssh23:30:400
4051054993630,4cyclictest4051050-21cyclictest21:30:452
4051054993625,8cyclictest529-21gdbus00:20:132
4051054993612,17cyclictest4170560-21diskmemload23:01:042
4051053993620,13cyclictest4139652-21sh22:20:451
405105299363,29cyclictest4181228-21ssh23:15:380
4051052993627,6cyclictest21280-21grep00:00:430
4051052993626,7cyclictest284-21systemd-journal22:35:140
405105499353,25cyclictest4177592-21ssh23:10:522
4051054993526,6cyclictest4181681-21switchtime23:16:142
4051054993526,6cyclictest20326-21/usr/sbin/munin00:00:262
4051054993525,8cyclictest875-21lldpd19:11:212
4051054993525,6cyclictest13690-21ntpq23:50:442
4051054993524,8cyclictest412-21avahi-daemon21:25:502
4051054993522,10cyclictest4060632-21ntp_kernel_pll_19:50:412
4051053993526,6cyclictest44386-21unixbench_singl00:36:151
4051053993525,6cyclictest4061030-21timerwakeupswit19:50:531
4051053993523,9cyclictest4069269-21latency_hist20:20:201
4051053993522,9cyclictest1724775-21munin-node21:20:131
405105399352,25cyclictest37339-21sh00:25:531
405105399350,28cyclictest4162675-21ssh22:50:421
4051052993526,6cyclictest4177666-21ntp_states23:11:060
4051052993522,10cyclictest437-21gpm19:38:100
4051052993521,12cyclictest4097860-21ssh21:26:240
4051052993520,13cyclictest1725264-21mta-sts-daemon19:27:460
4051052993520,12cyclictest4157753-21latency_hist22:45:210
405105299351,19cyclictest4131869-21ssh22:10:560
405105299351,16cyclictest4084684-21diskmemload21:15:530
405105499343,26cyclictest4155006-21ssh22:40:512
4051054993426,5cyclictest501-21in:imuxsock00:35:162
4051054993426,5cyclictest4163275-21unixbench_multi22:51:082
4051054993426,4cyclictest0-21swapper/200:05:502
4051054993423,5cyclictest0-21swapper/223:35:422
4051054993423,4cyclictest0-21swapper/222:20:522
4051054993422,8cyclictest12503-21true23:50:132
4051053993426,5cyclictest9136-21aten_r2power_po23:45:221
4051053993425,6cyclictest4147939-21unixbench_singl22:31:131
4051053993424,6cyclictest31100-21grep00:15:281
4051053993424,5cyclictest0-21swapper/100:11:031
4051053993423,5cyclictest0-21swapper/119:41:251
405105399342,27cyclictest4108343-21ssh21:40:511
4051052993426,6cyclictest4143419-21ntpq22:25:360
4051052993426,6cyclictest4143419-21ntpq22:25:360
4051052993426,5cyclictest4103297-21cron21:35:110
4051052993426,5cyclictest4077429-21fschecks_time20:45:260
4051052993426,5cyclictest20574-21latency_hist00:00:320
4051052993425,6cyclictest4072113-21grep20:25:470
4051052993425,6cyclictest1724775-21munin-node19:20:160
4051052993424,8cyclictest4055623-21ntpq19:31:550
4051052993424,8cyclictest4055623-21ntpq19:31:550
4051052993423,8cyclictest4107173-21/usr/sbin/munin21:40:220
4051052993418,13cyclictest1725264-21mta-sts-daemon19:47:020
4051052993417,13cyclictest77550irq/32-end021:10:580
4051054993326,4cyclictest1725266-21mta-sts-daemon19:20:062
4051054993325,5cyclictest4131738-21ntpq22:10:392
4051054993324,6cyclictest4174545-21grep23:06:142
4051054993322,7cyclictest46011-21latency_hist00:40:302
405105499332,25cyclictest4120071-21ssh21:55:582
4051054993319,8cyclictest4185211-21ssh23:21:082
4051053993326,4cyclictest4122712-21systemd-run22:00:211
4051053993322,6cyclictest1724775-21munin-node23:15:161
4051053993321,6cyclictest1725266-21mta-sts-daemon19:13:461
405105399331,26cyclictest4151021-21ssh22:35:361
4051052993327,3cyclictest0-21swapper/022:00:420
4051052993324,5cyclictest12516-21ssh23:50:160
4051052993322,8cyclictest4084021-21needreboot21:05:340
405105299332,25cyclictest1725265-21mta-sts-daemon20:20:440
4051054993223,6cyclictest1724775-21munin-node19:22:412
405105499322,23cyclictest4151338-21ssh22:36:032
405105499321,25cyclictest4085877-21ssh21:10:422
4051053993223,6cyclictest4074488-21latency20:35:261
4051052993224,6cyclictest824082-21snmpd00:16:010
4051052993224,6cyclictest437-21gpm21:00:450
4051052993224,5cyclictest4114758-21systemd-run21:50:120
4051052993224,5cyclictest4081761-21latency_hist21:00:220
4051052993224,5cyclictest25230-21/usr/sbin/munin00:06:060
4051052993222,7cyclictest6241-21ssh23:40:570
4051052993221,8cyclictest77550irq/32-end023:20:530
4051052993220,4cyclictest4170223-21ssh23:00:490
405105299321,29cyclictest0-21swapper/021:55:550
405105499313,21cyclictest4084684-21diskmemload22:45:442
4051054993124,4cyclictest0-21swapper/220:00:102
4051054993122,7cyclictest4128147-21xargs22:05:582
4051054993122,6cyclictest4078304-21grep20:45:572
4051054993120,8cyclictest21227-21missed_timers00:00:422
405105499311,21cyclictest4111954-21ssh21:45:412
4051053993125,3cyclictest4054387-21grep19:24:451
4051053993124,4cyclictest24252-21fschecks_count00:05:241
4051053993123,6cyclictest1724775-21munin-node23:21:041
4051053993122,6cyclictest1566-21aten_r2power_en23:35:211
4051053993121,8cyclictest4169223-21aten_r2power_en23:00:251
4051053993120,6cyclictest4082850-21timerandwakeup21:00:551
405105299313,25cyclictest4127761-21ssh22:05:390
4051052993125,3cyclictest0-21swapper/023:27:460
4051052993123,6cyclictest4051050-21cyclictest19:10:130
4051052993123,4cyclictest0-21swapper/020:10:340
4051052993122,6cyclictest4139859-21ntpq22:21:070
4051052993122,5cyclictest4155091-1kworker/0:0H-mmc_complete22:45:450
4051052993121,8cyclictest4051050-21cyclictest00:21:030
4051052993121,8cyclictest4051050-21cyclictest00:21:030
405105299311,15cyclictest4068529-21sshd20:15:470
4051054993023,3cyclictest0-21swapper/222:55:362
4051054993022,5cyclictest4064348-21cron20:05:102
405105499302,23cyclictest4104444-21ssh21:35:412
4051054993017,9cyclictest4059119-21ntp_states19:47:422
4051053993024,4cyclictest4051050-21cyclictest19:48:121
4051053993022,4cyclictest0-21swapper/123:35:431
4051053993014,12cyclictest4052909-21sort19:20:301
405105399301,25cyclictest4170347-21ssh23:01:001
405105399301,22cyclictest4112058-21rm21:45:491
4051054992921,5cyclictest4123297-21cut22:00:312
4051054992921,5cyclictest1725266-21mta-sts-daemon20:50:462
4051054992921,4cyclictest284-21systemd-journal21:00:142
4051054992921,4cyclictest0-21swapper/220:10:132
4051054992910,15cyclictest351ktimers/221:00:392
405105399292,20cyclictest4174026-21ssh23:06:031
4051053992921,5cyclictest4056175-21unixbench_multi19:35:231
4051053992921,5cyclictest4056175-21unixbench_multi19:35:231
4051053992921,3cyclictest0-21swapper/121:00:111
4051053992920,6cyclictest4101139-21/usr/sbin/munin21:31:131
4051053992916,7cyclictest1724775-21munin-node23:50:401
4051052992921,5cyclictest4076771-21unixbench_multi20:40:490
4051052992921,5cyclictest2469-21ssh23:35:420
4051052992912,14cyclictest4173726-21ssh23:05:350
4051054992820,5cyclictest4143977-21awk22:26:122
4051054992812,9cyclictest5031-21/usr/sbin/munin23:41:142
4051053992821,4cyclictest1725264-21mta-sts-daemon19:29:521
4051053992820,5cyclictest4107200-21aten_r2power_cu21:40:231
4051053992820,5cyclictest36189-21munin-run00:25:111
4051053992820,5cyclictest36189-21munin-run00:25:111
405105499271,21cyclictest824082-21snmpd20:40:342
405105399276,13cyclictest1724773-21mta-sts-daemon23:55:441
4051053992719,5cyclictest4155309-21ssh22:41:131
4051053992719,5cyclictest4116402-21ssh21:51:011
4051053992718,6cyclictest418-21dbus-daemon21:10:161
4051053992718,6cyclictest1725264-21mta-sts-daemon21:25:171
4051053992717,7cyclictest501-21in:imuxsock20:00:481
4051052992719,5cyclictest4061210-21cron19:55:100
4051052992718,7cyclictest284-21systemd-journal19:55:460
4051052992718,6cyclictest4079934-21unixbench_singl20:50:500
4051052992712,10cyclictest4097307-1kworker/0:1H+kblockd00:25:580
4051054992619,4cyclictest4067385-21unixbench_multi20:10:502
4051054992619,3cyclictest0-21swapper/221:10:152
4051054992617,6cyclictest1725255-21mta-sts-daemon19:26:172
4051053992618,5cyclictest4048209-21apt-get19:10:131
4051053992618,5cyclictest22026-21unixbench_multi00:01:241
4051053992617,6cyclictest4078145-21find20:45:551
4051052992618,6cyclictest0-21swapper/020:05:160
405105499251,9cyclictest4147349-21ntpq22:30:452
4051054992515,7cyclictest4070153-21processes20:20:482
405105399258,15cyclictest3019476-1kworker/1:2H+kblockd20:10:401
4051053992519,3cyclictest1725255-21mta-sts-daemon20:50:351
4051053992519,3cyclictest0-21swapper/120:00:171
4051053992517,5cyclictest4072122-21unixbench_singl20:25:471
4051053992517,5cyclictest1725264-21mta-sts-daemon19:40:161
4051053992515,6cyclictest4073197-21ntp_states20:30:451
4051053992515,6cyclictest4073197-21ntp_states20:30:451
4051052992516,6cyclictest4075226-21unixbench_singl20:35:460
405105399242,10cyclictest4070024-21ntpq20:20:371
4051053992414,7cyclictest4066020-21latency_hist20:10:141
4051053992313,7cyclictest4075905-21fschecks_time20:40:251
4051052992314,6cyclictest0-21swapper/020:30:220
4051052992314,6cyclictest0-21swapper/020:30:220
405105499222,15cyclictest4073213-21sshd20:30:452
405105499222,15cyclictest4073213-21sshd20:30:452
4051054992216,4cyclictest4051050-21cyclictest19:10:282
405105499212,12cyclictest4071559-21awk20:25:322
405105599202,10cyclictest0-21swapper/321:50:483
405105599193,10cyclictest0-21swapper/323:20:443
405105599182,8cyclictest0-21swapper/323:30:333
405105599182,8cyclictest0-21swapper/322:40:523
405105599182,6cyclictest0-21swapper/320:20:373
405105599182,10cyclictest0-21swapper/322:15:483
405105599174,7cyclictest0-21swapper/300:31:143
405105599173,9cyclictest0-21swapper/322:10:393
405105599173,7cyclictest0-21swapper/322:05:343
405105599173,6cyclictest0-21swapper/323:55:413
405105599172,9cyclictest0-21swapper/321:45:143
405105599172,10cyclictest0-21swapper/322:50:373
405105599165,6cyclictest0-21swapper/323:15:413
405105599164,9cyclictest0-21swapper/323:50:363
405105599164,7cyclictest0-21swapper/321:46:033
405105599162,8cyclictest0-21swapper/323:35:423
405105599162,8cyclictest0-21swapper/321:55:473
405105599162,8cyclictest0-21swapper/300:35:433
405105599162,7cyclictest0-21swapper/323:10:413
405105599155,7cyclictest0-21swapper/323:01:043
405105599155,6cyclictest0-21swapper/322:35:453
405105599153,8cyclictest0-21swapper/322:20:513
405105599153,7cyclictest0-21swapper/322:45:433
405105599153,6cyclictest0-21swapper/323:25:383
405105599152,8cyclictest0-21swapper/322:55:373
405105599152,7cyclictest0-21swapper/323:40:283
405105599152,7cyclictest0-21swapper/321:15:403
405105599152,6cyclictest0-21swapper/319:47:123
405105599151,9cyclictest0-21swapper/322:25:383
405105599151,9cyclictest0-21swapper/322:25:383
405105599151,8cyclictest0-21swapper/321:30:403
405105599151,8cyclictest0-21swapper/321:10:443
405105599151,7cyclictest0-21swapper/321:20:483
405105599151,7cyclictest0-21swapper/319:50:413
405105599151,7cyclictest0-21swapper/319:22:283
405105599151,6cyclictest0-21swapper/320:50:313
405105599142,7cyclictest0-21swapper/320:15:343
405105599141,8cyclictest0-21swapper/323:05:523
405105599141,8cyclictest0-21swapper/321:35:443
405105599141,8cyclictest0-21swapper/319:33:383
405105599141,8cyclictest0-21swapper/319:33:383
405105599141,8cyclictest0-21swapper/300:25:383
405105599141,8cyclictest0-21swapper/300:10:483
405105599141,7cyclictest0-21swapper/322:00:433
405105599141,6cyclictest0-21swapper/300:05:453
405105599132,7cyclictest0-21swapper/322:35:213
405105599132,7cyclictest0-21swapper/321:25:383
405105599132,7cyclictest0-21swapper/319:30:423
405105599132,7cyclictest0-21swapper/300:00:493
405105599131,6cyclictest0-21swapper/321:05:373
405105599131,6cyclictest0-21swapper/319:10:463
405105599131,4cyclictest0-21swapper/319:40:573
405105599122,7cyclictest0-21swapper/320:30:453
405105599122,7cyclictest0-21swapper/320:30:453
405105599122,7cyclictest0-21swapper/300:15:423
405105599122,6cyclictest0-21swapper/319:55:333
405105599121,7cyclictest0-21swapper/323:45:433
405105599121,7cyclictest0-21swapper/300:21:033
405105599121,7cyclictest0-21swapper/300:21:033
405105599121,6cyclictest0-21swapper/320:55:333
405105599121,6cyclictest0-21swapper/320:45:383
405105599121,6cyclictest0-21swapper/320:00:433
405105599112,5cyclictest0-21swapper/319:40:483
405105599111,7cyclictest0-21swapper/321:00:393
405105599111,6cyclictest0-21swapper/320:25:323
405105599104,4cyclictest0-21swapper/320:05:363
405105599101,6cyclictest0-21swapper/320:40:343
405105599101,6cyclictest0-21swapper/320:35:233
405105599101,6cyclictest0-21swapper/320:10:353
405105599101,6cyclictest0-21swapper/319:20:133
405105599101,5cyclictest0-21swapper/319:10:393
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional