You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-01-13 - 10:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Mon Jan 13, 2025 00:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
658889996536,25cyclictest688268-21grep20:30:300
658899995632,20cyclictest688271-21unixbench_multi20:30:303
658889995432,18cyclictest0-21swapper/022:35:000
658889995328,21cyclictest692790-21idleruntime-cro20:50:000
658889995043,4cyclictest666277-21idleruntime-cro19:30:010
658889995021,24cyclictest0-21swapper/021:55:010
658891994938,7cyclictest730849-21sh22:55:001
658895994830,6cyclictest131rcu_preempt20:50:072
658891994739,5cyclictest680168-21latency_hist20:10:001
658889994621,20cyclictest0-21swapper/020:45:000
658889994520,3cyclictest0-21swapper/021:05:200
658895994431,9cyclictest311ktimers/220:55:122
658889994334,6cyclictest705849-21fschecks_time21:30:110
658891994032,4cyclictest744329-21munin-run23:40:011
658889994033,4cyclictest726804-21sendmail22:40:000
658899993931,4cyclictest0-21swapper/322:35:153
658899993931,4cyclictest0-21swapper/319:57:113
658895993930,5cyclictest692793-21idleruntime-cro20:50:002
658895993830,4cyclictest703047-21auditctl21:20:002
658895993827,7cyclictest0-21swapper/222:55:002
658891993830,4cyclictest0-21swapper/121:15:001
658899993727,6cyclictest722264-21grep22:20:263
658899993725,7cyclictest748385-21sh23:55:003
65889599378,8cyclictest131rcu_preempt23:10:082
658895993730,5cyclictest686646-21kworker/u8:3+events_unbound20:42:222
658891993728,5cyclictest674548-21grep19:50:271
658891993728,5cyclictest674548-21grep19:50:261
658891993725,9cyclictest231ktimers/122:40:121
658895993629,4cyclictest740917-21idleruntime-cro23:30:012
658891993625,6cyclictest759471-21grep00:30:201
658889993629,4cyclictest719095-21munin-plugin-st22:15:000
658899993525,7cyclictest0-21swapper/323:30:003
658895993526,5cyclictest0-21swapper/221:10:262
658895993524,7cyclictest0-21swapper/219:40:012
658891993527,4cyclictest0-21swapper/120:15:251
658891993525,6cyclictest0-21swapper/120:32:171
658891993524,6cyclictest0-21swapper/119:55:251
658889993528,4cyclictest0-21swapper/019:35:010
658895993426,4cyclictest660628-21kthreadd19:15:012
658895993423,7cyclictest0-21swapper/200:35:002
658895993419,6cyclictest699264-21kworker/u8:2+events_unbound21:09:092
658891993425,4cyclictest0-21swapper/100:35:251
658889993428,3cyclictest708828-21cat21:40:000
658899993325,5cyclictest0-21swapper/322:15:153
658895993326,5cyclictest673039-21kworker/u8:1+events_unbound19:57:132
658895993325,4cyclictest0-21swapper/219:15:262
658891993324,5cyclictest0-21swapper/122:15:151
658891993322,6cyclictest669882-21cat19:40:011
658889993325,4cyclictest0-21swapper/021:10:260
658889993324,6cyclictest761824-21latency_hist00:40:010
658899993221,7cyclictest755412-21tail00:15:243
658895993224,4cyclictest0-21swapper/220:10:192
658895993213,6cyclictest131rcu_preempt22:20:122
658891993223,5cyclictest716737-21sh22:05:001
658891993223,4cyclictest0-21swapper/123:20:261
658889993225,4cyclictest744340-21idleruntime-cro23:40:000
658889993225,3cyclictest0-21swapper/000:00:000
658889993224,4cyclictest0-21swapper/020:20:010
658889993223,6cyclictest676752-21sendmail20:00:000
658889993222,6cyclictest0-21swapper/019:35:250
658889993221,6cyclictest0-21swapper/021:20:160
658899993124,4cyclictest0-21swapper/323:55:253
658899993124,4cyclictest0-21swapper/321:20:303
658899993123,4cyclictest756294-21fschecks_count00:20:163
658899993123,4cyclictest756294-21fschecks_count00:20:153
658899993123,4cyclictest0-21swapper/320:00:153
658899993120,7cyclictest701337-21auditctl21:15:003
658895993125,4cyclictest746009-21kworker/u8:2+events_unbound00:07:412
658895993123,4cyclictest0-21swapper/221:30:202
658895993120,6cyclictest0-21swapper/220:40:002
658891993124,4cyclictest711570-21latency_hist21:50:021
658891993124,3cyclictest0-21swapper/122:10:001
658891993123,4cyclictest0-21swapper/123:50:201
658891993123,4cyclictest0-21swapper/123:40:241
658891993123,4cyclictest0-21swapper/122:30:001
658889993123,6cyclictest0-21swapper/020:25:110
658889993120,8cyclictest755902-21sendmail00:20:000
658899993023,4cyclictest0-21swapper/319:30:293
658899993022,4cyclictest0-21swapper/323:35:243
658899993021,6cyclictest673747-21fschecks_time19:50:173
658899993021,6cyclictest673747-21fschecks_time19:50:173
65889599308,11cyclictest726427-21kworker/u8:0+events_unbound22:45:202
658895993022,4cyclictest0-21swapper/223:35:002
658895993022,4cyclictest0-21swapper/223:15:242
658895993022,4cyclictest0-21swapper/200:20:152
658895993022,4cyclictest0-21swapper/200:20:152
658891993023,4cyclictest681866-21auditctl20:15:011
658891993023,4cyclictest0-21swapper/121:00:231
658891993021,5cyclictest0-21swapper/123:55:161
658889993021,6cyclictest0-21swapper/021:45:000
658889993020,4cyclictest131rcu_preempt21:27:050
658899992922,4cyclictest0-21swapper/320:10:283
658899992921,4cyclictest0-21swapper/323:30:133
658899992920,6cyclictest0-21swapper/319:40:013
658899992915,10cyclictest391ktimers/320:40:113
65889599292,3cyclictest131rcu_preempt20:25:122
658895992923,4cyclictest738238-21kworker/u8:0+events_unbound23:21:442
658891992924,3cyclictest658880-21cyclictest20:59:001
658889992922,4cyclictest0-21swapper/020:05:010
658889992920,6cyclictest199-21systemd-network00:10:140
658889992920,6cyclictest199-21systemd-network00:10:140
658889992919,6cyclictest440-21cron20:40:000
658899992821,3cyclictest0-21swapper/319:25:253
658899992819,6cyclictest0-21swapper/320:05:173
658899992819,5cyclictest0-21swapper/322:15:003
65889599283,5cyclictest131rcu_preempt19:40:122
658895992822,4cyclictest719043-21kworker/u8:2+events_unbound22:18:442
658895992821,5cyclictest662820-21kworker/u8:2+events_unbound19:30:182
658895992821,4cyclictest0-21swapper/221:40:242
658895992820,5cyclictest755510-21kworker/u8:1+events_unbound00:17:492
658895992820,5cyclictest0-21swapper/221:00:232
658895992818,5cyclictest0-21swapper/222:00:002
658895992810,3cyclictest131rcu_preempt22:30:092
658891992818,7cyclictest0-21swapper/121:45:011
658889992821,3cyclictest0-21swapper/019:15:020
658889992820,4cyclictest0-21swapper/020:55:260
658899992722,2cyclictest0-21swapper/320:55:163
658899992720,4cyclictest0-21swapper/319:15:023
658899992719,4cyclictest0-21swapper/323:12:453
658899992717,7cyclictest662906-21seq19:20:013
658895992720,4cyclictest704768-21sh21:25:002
658895992720,4cyclictest0-21swapper/200:40:012
658895992719,4cyclictest0-21swapper/219:45:152
65889599271,14cyclictest0-21swapper/222:55:382
658891992721,3cyclictest0-21swapper/120:35:261
658891992721,3cyclictest0-21swapper/119:30:021
658891992721,3cyclictest0-21swapper/100:15:221
658891992720,3cyclictest0-21swapper/120:40:151
658891992717,7cyclictest734617-21seq23:06:281
658891992717,6cyclictest660609-21munin-node19:15:011
658891992717,6cyclictest0-21swapper/120:50:211
658889992721,3cyclictest0-21swapper/022:15:200
658889992718,7cyclictest121ktimers/022:55:100
658899992619,5cyclictest391ktimers/319:40:143
658899992619,4cyclictest0-21swapper/321:50:203
658899992619,3cyclictest0-21swapper/320:50:213
658899992618,4cyclictest759940-21sh00:34:593
65889599267,4cyclictest131rcu_preempt20:15:112
65889599266,12cyclictest32-21ksoftirqd/222:25:332
65889599263,12cyclictest32-21ksoftirqd/200:11:322
65889599263,12cyclictest32-21ksoftirqd/200:11:312
658895992620,4cyclictest748347-21kworker/u8:1+events_unbound23:55:142
658895992620,4cyclictest699264-21kworker/u8:2+events_unbound21:38:392
658895992619,5cyclictest710342-21kworker/u8:1+events_unbound21:51:332
658895992619,4cyclictest757303-21kworker/u8:0+events_unbound00:27:182
658895992618,5cyclictest0-21swapper/223:40:242
658895992618,4cyclictest0-21swapper/223:50:122
65889599261,12cyclictest0-21swapper/220:23:492
658891992619,4cyclictest0-21swapper/100:10:201
658891992619,4cyclictest0-21swapper/100:10:201
658891992618,4cyclictest0-21swapper/123:15:151
658889992619,3cyclictest0-21swapper/023:10:200
658899992519,3cyclictest0-21swapper/300:35:153
658899992511,9cyclictest0-21swapper/322:00:153
658895992519,4cyclictest750346-21kworker/u8:3+events_unbound00:04:582
658895992519,4cyclictest750346-21kworker/u8:3+events_unbound00:04:582
658895992519,3cyclictest0-21swapper/223:05:012
65889599251,6cyclictest725310-21apt-get22:35:112
658895992516,7cyclictest705211-21kworker/u8:0+events_unbound22:01:002
658895992516,6cyclictest675215-21ls19:55:022
658895992516,6cyclictest675215-21ls19:55:012
658891992520,3cyclictest751851-21latency_hist00:05:011
658891992520,3cyclictest751851-21latency_hist00:05:001
658891992519,3cyclictest0-21swapper/122:30:151
658891992519,3cyclictest0-21swapper/100:10:001
658891992518,4cyclictest729152-21latency_hist22:50:001
658891992518,3cyclictest0-21swapper/122:25:011
658891992517,5cyclictest0-21swapper/119:15:161
65888999253,3cyclictest710545-21apt-get21:45:020
658889992519,4cyclictest672550-21mailstats19:45:220
658889992514,8cyclictest750803-21meminfo00:00:200
658889992514,8cyclictest750803-21meminfo00:00:190
65888999251,3cyclictest670142-21apt-get19:40:130
65888999251,10cyclictest742632-21awk23:35:000
658899992418,3cyclictest0-21swapper/321:20:003
658899992416,4cyclictest0-21swapper/321:07:213
658899992412,7cyclictest215-21dbus-daemon23:17:473
658895992418,4cyclictest673039-21kworker/u8:1+events_unbound20:02:152
65889599241,3cyclictest131rcu_preempt22:40:122
65889599241,12cyclictest656815-21kworker/2:0+mm_percpu_wq23:09:042
65889599241,12cyclictest0-21swapper/222:06:502
65889599241,11cyclictest0-21swapper/221:29:582
658891992418,4cyclictest673039-21kworker/u8:1+events_unbound20:02:131
658891992418,3cyclictest0-21swapper/119:20:211
658891992417,5cyclictest728739-21kworker/u8:3+events_unbound22:57:431
658891992415,6cyclictest746875-21sed23:50:011
658891992415,5cyclictest0-21swapper/121:35:001
658891992411,9cyclictest1-21systemd22:12:371
65888999243,19cyclictest0-21swapper/022:46:350
658889992419,3cyclictest13650irq/42-30be0000.ethernet20:05:150
658889992418,4cyclictest0-21swapper/023:20:010
658889992417,3cyclictest0-21swapper/021:15:150
658889992417,3cyclictest0-21swapper/000:30:110
65888999241,6cyclictest681408-21grep20:10:280
658889992414,7cyclictest756714-21awk00:20:220
658889992414,7cyclictest756714-21awk00:20:220
658889992414,7cyclictest661247-21awk19:15:030
65888999241,19cyclictest0-21swapper/021:00:040
65888999241,10cyclictest730872-21awk22:55:000
65888999240,20cyclictest0-21swapper/022:44:210
658899992317,3cyclictest0-21swapper/323:40:183
658899992317,3cyclictest0-21swapper/321:35:143
658899992315,4cyclictest391ktimers/320:20:013
658899992314,6cyclictest734914-21cron23:10:003
658899992312,6cyclictest710752-21apt-key21:45:013
658895992317,4cyclictest705211-21kworker/u8:0+events_unbound22:12:552
658891992317,3cyclictest0-21swapper/123:30:001
658891992316,4cyclictest0-21swapper/119:40:251
658891992315,5cyclictest0-21swapper/123:10:131
658891992313,6cyclictest0-21swapper/121:55:161
658891992313,6cyclictest0-21swapper/119:45:241
658889992317,3cyclictest0-21swapper/020:20:180
658889992317,3cyclictest0-21swapper/019:20:250
658889992316,4cyclictest0-21swapper/023:00:240
658889992316,3cyclictest0-21swapper/023:42:590
658889992316,3cyclictest0-21swapper/019:51:270
658889992316,3cyclictest0-21swapper/019:51:270
658889992315,5cyclictest0-21swapper/023:10:000
658889992315,4cyclictest0-21swapper/000:08:360
65888999231,20cyclictest0-21swapper/000:26:310
65888999231,19cyclictest747022-21df_inode23:50:100
65888999230,19cyclictest0-21swapper/023:29:490
65888999230,19cyclictest0-21swapper/023:21:010
658899992216,3cyclictest0-21swapper/322:50:103
658899992216,3cyclictest0-21swapper/321:30:013
658899992215,4cyclictest0-21swapper/320:40:003
658899992215,4cyclictest0-21swapper/319:20:263
658899992214,6cyclictest723594-21kworker/u8:1+events_unbound22:40:123
658899992214,4cyclictest440-21cron19:50:003
658899992213,6cyclictest752878-21uniq00:10:123
658899992213,6cyclictest752878-21uniq00:10:123
65889599221,9cyclictest678306-21kworker/u8:2+events_power_efficient20:06:542
658895992216,4cyclictest710342-21kworker/u8:1+events_unbound21:45:252
658895992216,3cyclictest746009-21kworker/u8:2-ext4-rsv-conversion23:50:002
658891992216,4cyclictest231ktimers/121:28:101
658891992214,5cyclictest0-21swapper/121:35:191
658891992214,5cyclictest0-21swapper/121:15:241
658891992213,5cyclictest699203-21unixbench_singl21:05:271
658891992213,5cyclictest299-21systemd-logind21:52:291
65888999228,12cyclictest714042-21missed_timers21:55:200
658889992215,3cyclictest0-21swapper/022:09:140
65888999221,19cyclictest0-21swapper/022:24:450
658899992116,3cyclictest0-21swapper/321:00:223
658899992114,3cyclictest0-21swapper/300:00:253
658899992114,3cyclictest0-21swapper/300:00:253
658899992112,7cyclictest725282-21sed22:35:013
658899992112,6cyclictest711599-21cat21:50:013
658899992112,6cyclictest0-21swapper/323:00:233
65889599211,12cyclictest0-21swapper/219:27:032
65889199212,15cyclictest757611-21awk00:25:001
65889199212,15cyclictest757611-21awk00:25:001
658891992115,4cyclictest723594-21kworker/u8:1+events_unbound22:37:421
658891992115,3cyclictest0-21swapper/123:00:141
658891992115,3cyclictest0-21swapper/121:20:301
658891992115,3cyclictest0-21swapper/120:50:011
658889992117,2cyclictest0-21swapper/023:45:140
65888999211,3cyclictest0-21swapper/020:51:090
65888999211,18cyclictest0-21swapper/022:26:200
65888999210,19cyclictest0-21swapper/022:01:030
658899992014,3cyclictest0-21swapper/322:55:233
658895992014,4cyclictest686646-21kworker/u8:3+events_unbound20:30:422
65889199209,8cyclictest685681-21cut20:25:151
658891992014,3cyclictest0-21swapper/120:20:171
65889999199,7cyclictest0-21swapper/321:30:203
658899991913,4cyclictest391ktimers/300:10:013
658899991913,3cyclictest0-21swapper/323:20:163
658899991913,3cyclictest0-21swapper/321:55:173
658899991912,5cyclictest391ktimers/320:25:123
658899991912,4cyclictest0-21swapper/322:09:093
658899991911,6cyclictest758274-21sed00:30:003
65889199191,3cyclictest0-21swapper/100:27:101
658899991812,4cyclictest637-21runrttasks22:28:303
658899991810,5cyclictest637-21runrttasks22:49:143
65889999171,12cyclictest746688-21idleruntime-cro23:50:013
658899991611,2cyclictest0-21swapper/320:46:563
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional