You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-03-25 - 21:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack2slot7s.osadl.org (updated Tue Mar 25, 2025 12:41:59)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
393442996556,5cyclictest496319-21mailstats11:02:081
393442996556,5cyclictest496319-21mailstats11:02:081
393442996355,5cyclictest436100-21munin-run09:20:011
393442996355,5cyclictest436100-21munin-run09:20:011
393441995547,4cyclictest0-21swapper/009:41:590
393441995536,5cyclictest0-21swapper/009:17:010
393441995536,5cyclictest0-21swapper/009:17:010
39344199546,37cyclictest456305-21ssh09:57:010
393442995236,9cyclictest547381-21rm12:16:571
393442995142,5cyclictest959-21mta-sts-daemon11:09:211
393442995142,5cyclictest959-21mta-sts-daemon11:09:211
393441995041,6cyclictest3786617-21cupsd11:37:020
393442994941,5cyclictest422-21dbus-daemon11:50:021
393443994840,5cyclictest507351-21systemctl11:20:012
393442994838,6cyclictest3786642-21cups-browsed11:37:021
393442994823,22cyclictest516893-21sh11:35:021
393442994739,5cyclictest553557-21systemd-run12:25:021
393441994736,7cyclictest0-21swapper/008:06:590
393441994731,13cyclictest409920-21cron08:05:010
393441994720,17cyclictest422-21dbus-daemon12:02:020
393441994718,20cyclictest479813-21ssh10:37:010
393442994625,18cyclictest534977-21ls12:00:011
393442994625,18cyclictest534977-21ls12:00:011
39344299462,19cyclictest528952-21ssh11:52:011
39344299462,16cyclictest543442-21ssh12:11:541
393442994621,3cyclictest0-21swapper/110:21:581
393441994634,8cyclictest0-21swapper/010:45:030
393443994531,11cyclictest488458-21if_wlan010:51:502
39344399451,36cyclictest492460-21ssh10:57:032
39344299459,10cyclictest0-21swapper/109:12:091
39344299453,24cyclictest456228-21ssh09:56:581
39344299453,13cyclictest537036-21ssh12:02:071
393442994524,18cyclictest521823-21fschecks_count11:41:521
39344299451,22cyclictest442417-21ssh09:32:011
393443994437,3cyclictest0-21swapper/209:12:032
393442994419,7cyclictest397896-21unixbench_singl07:22:101
393442994418,3cyclictest0-21swapper/108:16:521
39344199442,36cyclictest476525-21ssh10:31:580
393441994420,15cyclictest151ktimers/008:32:070
393443994335,5cyclictest435094-21/usr/sbin/munin09:17:112
393443994335,5cyclictest435094-21/usr/sbin/munin09:17:112
393442994333,6cyclictest476115-21sh10:31:491
39344299433,18cyclictest558155-21rm12:31:571
393442994330,10cyclictest492285-21needreboot10:56:571
393442994316,5cyclictest0-21swapper/110:36:581
393441994327,8cyclictest551437-21sh12:22:000
393443994236,3cyclictest0-21swapper/211:05:012
393443994236,3cyclictest0-21swapper/211:05:012
393443994234,4cyclictest415950-21kworker/u8:8+xprtiod08:30:012
393442994233,6cyclictest266-21systemd-journal08:35:011
39344299422,15cyclictest483052-21ssh10:42:041
393441994235,4cyclictest534976-21ssh12:00:010
393441994235,4cyclictest534976-21ssh12:00:010
393443994133,5cyclictest462988-21systemd-run10:10:012
393443994132,6cyclictest421-21avahi-daemon10:12:032
393443994132,6cyclictest405438-21true07:50:012
393443994132,5cyclictest549561-21systemctl12:20:012
393442994134,4cyclictest429443-21ssh09:10:021
393442994131,6cyclictest445909-21unixbench_singl09:37:121
393442994116,4cyclictest956-21mta-sts-daemon10:11:571
393443994030,6cyclictest420414-21munin-run08:40:012
393443994030,6cyclictest420414-21munin-run08:40:012
39344299402,20cyclictest467929-21ssh10:17:011
393441994031,6cyclictest3786642-21cups-browsed10:21:590
393441994028,7cyclictest12550irq/33-eth012:37:080
393441994027,8cyclictest0-21swapper/007:32:020
39344199401,31cyclictest0-21swapper/010:02:030
393443993930,6cyclictest959-21mta-sts-daemon11:25:012
393442993928,6cyclictest454662-21cron09:55:011
393441993929,6cyclictest3786642-21cups-browsed11:48:160
393443993830,5cyclictest560214-21idleruntime-cro12:35:012
393443993828,7cyclictest564150-21cron12:40:012
393443993827,8cyclictest518398-21latency11:36:562
39344299383,16cyclictest504194-21sshd11:15:301
393442993831,4cyclictest957-21mta-sts-daemon09:41:531
393441993825,4cyclictest427842-21tail09:02:150
393443993729,5cyclictest484766-21munin-plugin-st10:45:012
393443993729,5cyclictest421944-21systemd-run08:45:012
393442993726,7cyclictest421-21avahi-daemon10:45:161
393442993723,10cyclictest502464-21unixbench_multi11:12:081
393442993723,10cyclictest502464-21unixbench_multi11:12:081
39344199373,26cyclictest151ktimers/008:22:030
393441993729,4cyclictest956-21mta-sts-daemon11:00:020
393441993728,6cyclictest421-21avahi-daemon09:49:360
393441993728,6cyclictest3786642-21cups-browsed12:19:290
393441993725,8cyclictest3786642-21cups-browsed07:12:280
39344299363,10cyclictest509200-21ssh11:22:051
393442993627,6cyclictest3786642-21cups-browsed12:09:001
393442993625,8cyclictest417428-21cut08:30:021
393441993629,5cyclictest446872-21systemd-run09:40:010
393441993629,5cyclictest422-21dbus-daemon07:55:020
39344199362,26cyclictest502013-21ssh11:12:010
39344199362,26cyclictest502013-21ssh11:12:010
393443993529,3cyclictest0-21swapper/210:40:012
393443993527,5cyclictest406982-21latency_hist07:55:022
393443993526,6cyclictest400939-21systemd-run07:35:012
393442993528,4cyclictest0-21swapper/107:40:011
393442993528,4cyclictest0-21swapper/107:40:011
393441993527,5cyclictest421-21avahi-daemon11:41:230
393441993525,8cyclictest453-21systemd-logind07:20:010
393443993429,2cyclictest0-21swapper/209:30:022
393443993427,4cyclictest531017-21munin-run11:55:012
393443993427,4cyclictest0-21swapper/211:45:012
393443993427,4cyclictest0-21swapper/211:31:572
393443993426,5cyclictest459750-21switchtime10:02:102
393443993425,6cyclictest3786642-21cups-browsed12:08:382
393443993425,6cyclictest3786642-21cups-browsed09:46:132
393443993424,6cyclictest3786642-21cups-browsed12:02:242
393443993422,8cyclictest545580-21cron12:15:012
393443993413,5cyclictest36-21ksoftirqd/209:58:222
39344299343,25cyclictest3786642-21cups-browsed07:47:031
393442993426,5cyclictest408408-21idleruntime-cro08:00:011
393442993426,5cyclictest396452-21sendmail07:20:011
39344299342,24cyclictest488906-21ssh10:52:011
393441993427,4cyclictest393446-21systemd-run07:10:010
393441993426,4cyclictest0-21swapper/008:00:020
393441993425,7cyclictest412906-21cron08:15:010
393441993425,6cyclictest441906-21fschecks_time09:31:500
39344199342,25cyclictest464620-21ssh10:12:010
393441993419,3cyclictest0-21swapper/012:11:580
393441993417,12cyclictest151ktimers/008:37:020
393441993417,12cyclictest151ktimers/008:37:020
393441993415,12cyclictest12450irq/32-eth012:31:540
39344199341,27cyclictest514940-21ssh11:31:540
393443993325,5cyclictest415957-21systemd-run08:25:012
393443993321,9cyclictest1-21systemd09:21:492
393443993317,12cyclictest351ktimers/209:51:582
393443993312,5cyclictest36-21ksoftirqd/211:55:562
393443993312,5cyclictest36-21ksoftirqd/211:55:562
393443993312,3cyclictest36-21ksoftirqd/212:28:442
393442993327,3cyclictest0-21swapper/111:30:021
393442993326,3cyclictest0-21swapper/112:37:011
393442993325,4cyclictest556429-21latency_hist12:30:021
393442993324,4cyclictest0-21swapper/108:12:081
393441993325,6cyclictest474928-21latency_hist10:30:030
393441993320,9cyclictest467378-21aten2.4-expect10:16:510
393441993318,11cyclictest0-21swapper/011:17:070
39344399328,4cyclictest36-21ksoftirqd/207:37:002
39344399328,4cyclictest36-21ksoftirqd/207:37:002
393443993227,2cyclictest0-21swapper/209:00:012
393443993224,5cyclictest469651-21munin-plugin-st10:20:012
393443993222,7cyclictest417797-21aten_r2power_po08:31:522
39344399322,22cyclictest448245-21ssh09:41:592
393443993212,5cyclictest36-21ksoftirqd/210:28:382
393443993212,4cyclictest36-21ksoftirqd/211:08:512
393443993212,4cyclictest36-21ksoftirqd/211:08:512
393443993212,10cyclictest36-21ksoftirqd/210:48:092
393443993211,6cyclictest36-21ksoftirqd/208:02:042
393443993210,4cyclictest36-21ksoftirqd/211:11:562
393443993210,4cyclictest36-21ksoftirqd/211:11:562
393443993210,4cyclictest36-21ksoftirqd/210:22:012
393442993225,3cyclictest0-21swapper/109:30:011
393442993224,5cyclictest426416-21sendmail09:00:011
393442993224,5cyclictest420467-21latency_hist08:40:021
393442993224,5cyclictest420467-21latency_hist08:40:021
393442993224,4cyclictest0-21swapper/108:52:021
393442993223,6cyclictest3786642-21cups-browsed08:22:081
39344299322,24cyclictest437859-21ssh09:22:071
39344299322,22cyclictest3786642-21cups-browsed08:07:001
393441993225,4cyclictest489396-21grep10:52:110
393441993224,5cyclictest403957-21latency_hist07:45:010
39344199322,23cyclictest657-21snmpd11:22:150
393441993218,12cyclictest0-21swapper/011:51:490
39344199321,26cyclictest496095-21ssh11:02:020
39344199321,26cyclictest496095-21ssh11:02:020
39344399319,4cyclictest36-21ksoftirqd/208:46:562
39344399317,5cyclictest36-21ksoftirqd/207:26:592
393443993124,4cyclictest957-21mta-sts-daemon12:21:502
393443993123,5cyclictest957-21mta-sts-daemon09:01:562
393443993122,7cyclictest393440-21cyclictest10:31:492
393443993112,5cyclictest36-21ksoftirqd/209:31:062
393443993110,4cyclictest36-21ksoftirqd/208:12:062
39344299311,23cyclictest459011-21awk10:01:541
393441993121,7cyclictest3786642-21cups-browsed09:51:040
393443993022,5cyclictest453-21systemd-logind08:20:012
393443993022,5cyclictest397928-21cron07:25:012
393442993023,4cyclictest959-21mta-sts-daemon09:46:401
393442993022,5cyclictest398406-21cpuspeed07:26:511
393442993022,5cyclictest393958-21fschecks_count07:12:201
393442993021,6cyclictest421-21avahi-daemon08:02:091
393441993025,2cyclictest0-21swapper/007:30:010
393441993024,4cyclictest959-21mta-sts-daemon10:09:080
393441993023,3cyclictest0-21swapper/008:27:050
393441993022,5cyclictest422-21dbus-daemon09:10:020
39344399298,9cyclictest36-21ksoftirqd/208:07:002
39344399298,4cyclictest36-21ksoftirqd/211:47:262
39344399298,4cyclictest36-21ksoftirqd/209:07:012
39344399298,17cyclictest422-21dbus-daemon07:12:282
39344399298,11cyclictest36-21ksoftirqd/207:17:042
393443992921,5cyclictest513338-21ssh11:30:012
393443992910,4cyclictest36-21ksoftirqd/207:57:002
393443992910,4cyclictest36-21ksoftirqd/207:42:002
393442992921,5cyclictest453-21systemd-logind08:50:011
393442992921,5cyclictest3786642-21cups-browsed09:01:261
39344199297,12cyclictest151ktimers/008:42:010
39344199296,13cyclictest437-21mta-sts-daemon07:47:040
393441992924,2cyclictest0-21swapper/007:40:010
393441992924,2cyclictest0-21swapper/007:40:010
393441992923,4cyclictest423438-21kworker/u8:10-xprtiod09:15:030
393441992922,4cyclictest955-21mta-sts-daemon08:17:100
393441992922,4cyclictest0-21swapper/009:22:130
393441992921,4cyclictest0-21swapper/007:25:010
393441992918,7cyclictest0-21swapper/011:30:010
39344199291,24cyclictest498735-21ssh11:06:280
39344199291,24cyclictest498735-21ssh11:06:280
39344299284,12cyclictest429425-21diskmemload10:09:291
393442992821,3cyclictest0-21swapper/107:55:021
393442992819,6cyclictest959-21mta-sts-daemon10:26:141
393441992821,5cyclictest556387-21latency_hist12:30:020
393442992720,3cyclictest0-21swapper/107:45:021
393441992717,7cyclictest191rcuc/008:57:010
39344399269,4cyclictest36-21ksoftirqd/208:52:092
39344399267,4cyclictest36-21ksoftirqd/209:36:472
39344199261,10cyclictest436-21gpm10:46:550
39344299252,17cyclictest657-21snmpd07:32:071
393441992412,8cyclictest0-21swapper/012:09:340
393442992317,3cyclictest0-21swapper/108:42:081
39344199237,12cyclictest422-21dbus-daemon09:27:250
39344199222,15cyclictest424281-21ntpq08:52:020
393441992217,3cyclictest151ktimers/008:46:550
39344399216,6cyclictest36-21ksoftirqd/207:10:022
39344499187,7cyclictest0-21swapper/312:31:553
39344499181,12cyclictest0-21swapper/310:31:573
39344499181,11cyclictest0-21swapper/311:42:003
39344499180,12cyclictest0-21swapper/311:02:013
39344499180,12cyclictest0-21swapper/311:02:013
393442991812,3cyclictest0-21swapper/107:10:021
39344499178,5cyclictest0-21swapper/310:42:053
39344499171,12cyclictest0-21swapper/309:31:553
39344499171,11cyclictest0-21swapper/307:32:063
39344499170,14cyclictest0-21swapper/307:10:013
39344499170,11cyclictest0-21swapper/310:11:543
39344499161,11cyclictest0-21swapper/312:16:583
39344499161,11cyclictest0-21swapper/311:51:583
39344499161,11cyclictest0-21swapper/311:22:013
39344499161,11cyclictest0-21swapper/310:51:563
39344499161,11cyclictest0-21swapper/310:02:023
39344499161,11cyclictest0-21swapper/309:57:003
393444991610,4cyclictest0-21swapper/307:42:023
39344499160,11cyclictest0-21swapper/309:12:043
39344499160,11cyclictest0-21swapper/308:46:563
39344499160,11cyclictest0-21swapper/308:37:023
39344499160,11cyclictest0-21swapper/308:37:023
39344499151,11cyclictest0-21swapper/309:21:493
39344499151,10cyclictest0-21swapper/312:35:593
39344499151,10cyclictest0-21swapper/312:11:553
39344499151,10cyclictest0-21swapper/311:56:593
39344499151,10cyclictest0-21swapper/311:56:593
39344499151,10cyclictest0-21swapper/311:36:533
39344499151,10cyclictest0-21swapper/310:47:233
39344499151,10cyclictest0-21swapper/310:36:593
39344499151,10cyclictest0-21swapper/310:17:003
39344499151,10cyclictest0-21swapper/309:50:013
39344499151,10cyclictest0-21swapper/308:57:033
39344499151,10cyclictest0-21swapper/308:12:033
39344499151,10cyclictest0-21swapper/308:07:003
39344499151,10cyclictest0-21swapper/307:52:053
39344499151,10cyclictest0-21swapper/307:47:023
39344499151,10cyclictest0-21swapper/307:37:013
39344499151,10cyclictest0-21swapper/307:37:013
39344499151,10cyclictest0-21swapper/307:27:023
39344499150,11cyclictest0-21swapper/311:31:543
39344499150,11cyclictest0-21swapper/309:37:033
39344499150,10cyclictest0-21swapper/308:41:593
39344499148,4cyclictest0-21swapper/311:50:023
39344499148,4cyclictest0-21swapper/309:41:593
39344499147,5cyclictest0-21swapper/310:57:073
39344499141,9cyclictest0-21swapper/311:16:383
39344499141,9cyclictest0-21swapper/311:10:153
39344499141,9cyclictest0-21swapper/311:10:153
39344499141,9cyclictest0-21swapper/308:21:573
39344499141,10cyclictest0-21swapper/312:21:493
39344499141,10cyclictest0-21swapper/312:01:583
39344499141,10cyclictest0-21swapper/310:28:513
39344499141,10cyclictest0-21swapper/310:22:033
39344499141,10cyclictest0-21swapper/309:16:523
39344499141,10cyclictest0-21swapper/309:16:523
39344499141,10cyclictest0-21swapper/309:07:053
39344499141,10cyclictest0-21swapper/308:30:023
39344499140,10cyclictest0-21swapper/312:07:093
39344499140,10cyclictest0-21swapper/311:27:403
39344499140,10cyclictest0-21swapper/309:50:343
39344499140,10cyclictest0-21swapper/309:02:053
39344499140,10cyclictest0-21swapper/307:57:023
39344499140,10cyclictest0-21swapper/307:16:583
39344499131,9cyclictest0-21swapper/310:06:233
39344499131,9cyclictest0-21swapper/308:51:523
39344499131,9cyclictest0-21swapper/307:21:583
39344499130,9cyclictest0-21swapper/312:26:573
39344499130,10cyclictest0-21swapper/311:05:123
39344499130,10cyclictest0-21swapper/311:05:123
39344499130,10cyclictest0-21swapper/309:27:093
39344499130,10cyclictest0-21swapper/308:02:033
39344499130,10cyclictest0-21swapper/307:12:323
39344499121,9cyclictest0-21swapper/308:16:583
39344499121,10cyclictest0-21swapper/308:32:053
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional